[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:14 dist-test-slave-68xk krb5kdc[27652](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:14 dist-test-slave-68xk krb5kdc[27652](info): set up 2 sockets
Aug 07 06:17:14 dist-test-slave-68xk krb5kdc[27652](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 06:17:15.493139 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:15 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:15.628469 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44723
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:15.740368 27671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:15.740630 27671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:15.740669 27671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:15.744546 27671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:15.744598 27671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:15.744617 27671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:15.744634 27671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:15.744649 27671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:15.749796 27671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:15.750872 27671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:15.751896 27671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:15.762619 27678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:15.762691 27671 server_base.cc:1034] running on GCE node
W20260807 06:17:15.762614 27677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:15.762614 27680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:15.763517 27671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:15.764688 27671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:15.765883 27671 hybrid_clock.cc:648] HybridClock initialized: now 1786083435765866 us; error 97 us; skew 500 ppm
Aug 07 06:17:15 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083435, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:15.768940 27671 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:15.769821 27671 webserver.cc:460] Webserver started at http://127.26.252.126:36465/ using document root <none> and password file <none>
I20260807 06:17:15.770355 27671 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:15.770458 27671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:15.770664 27671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:15.772706 27671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "d48ce753914a40f3b459c9b764c70798"
format_stamp: "Formatted at 2026-08-07 06:17:15 on dist-test-slave-68xk"
server_key: "69c126d6b9aa580b3379c165e86874c4"
server_key_iv: "47ee0a93f6bcfd8c4001afaca590b2ce"
server_key_version: "encryptionkey@0"
I20260807 06:17:15.773227 27671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "d48ce753914a40f3b459c9b764c70798"
format_stamp: "Formatted at 2026-08-07 06:17:15 on dist-test-slave-68xk"
server_key: "69c126d6b9aa580b3379c165e86874c4"
server_key_iv: "47ee0a93f6bcfd8c4001afaca590b2ce"
server_key_version: "encryptionkey@0"
I20260807 06:17:15.777376 27671 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 06:17:15.779837 27687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:15.781091 27671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:15.781195 27671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "d48ce753914a40f3b459c9b764c70798"
format_stamp: "Formatted at 2026-08-07 06:17:15 on dist-test-slave-68xk"
server_key: "69c126d6b9aa580b3379c165e86874c4"
server_key_iv: "47ee0a93f6bcfd8c4001afaca590b2ce"
server_key_version: "encryptionkey@0"
I20260807 06:17:15.781286 27671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:15.801463 27671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:15.804885 27671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:15.805073 27671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:15.812875 27671 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44723
I20260807 06:17:15.812908 27761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44723 every 8 connection(s)
I20260807 06:17:15.813862 27671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:15.815506 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27671
I20260807 06:17:15.815666 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:15.816763 27762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:15.817047 27633 external_mini_cluster.cc:1428] Setting key 43eb0cfc938072211953eb4fc2425eee
I20260807 06:17:15.823468 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798: Bootstrap starting.
I20260807 06:17:15.825732 27762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:15.826570 27762 log.cc:824] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:15.828495 27762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798: No bootstrap required, opened a new log
I20260807 06:17:15.831987 27762 raft_consensus.cc:348] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } }
I20260807 06:17:15.832226 27762 raft_consensus.cc:374] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:15.832293 27762 raft_consensus.cc:729] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d48ce753914a40f3b459c9b764c70798, State: Initialized, Role: FOLLOWER
I20260807 06:17:15.832731 27762 consensus_queue.cc:260] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } }
I20260807 06:17:15.832851 27762 raft_consensus.cc:388] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:15.832937 27762 raft_consensus.cc:482] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:15.833050 27762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:15.833909 27762 raft_consensus.cc:504] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } }
I20260807 06:17:15.834249 27762 leader_election.cc:302] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d48ce753914a40f3b459c9b764c70798; no voters:
Aug 07 06:17:15 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:15.834630 27762 leader_election.cc:288] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:15.834743 27768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:15.834990 27768 raft_consensus.cc:686] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [term 1 LEADER]: Becoming Leader. State: Replica: d48ce753914a40f3b459c9b764c70798, State: Running, Role: LEADER
I20260807 06:17:15.835322 27768 consensus_queue.cc:237] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } }
I20260807 06:17:15.835878 27762 sys_catalog.cc:564] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:15.837096 27770 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d48ce753914a40f3b459c9b764c70798. Latest consensus state: current_term: 1 leader_uuid: "d48ce753914a40f3b459c9b764c70798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } } }
I20260807 06:17:15.837235 27770 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:15.837626 27782 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:15.837563 27769 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d48ce753914a40f3b459c9b764c70798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48ce753914a40f3b459c9b764c70798" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44723 } } }
I20260807 06:17:15.837750 27769 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:15.841178 27782 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:15.841960 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:15.820356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32916 (local address 127.26.252.126:44723)
0807 06:17:15.820778 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:15.820794 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:15.822034 (+ 1240us) server_negotiation.cc:407] Connection header received
0807 06:17:15.825190 (+ 3156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:15.825205 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:15.825516 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:15.825844 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:15.828079 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:15.829129 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:15.830311 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:15.830847 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:15.831024 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:15.835581 (+ 4557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:15.835587 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:15.835601 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:15.835633 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:15.837964 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:15.838648 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:15.838654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:15.838659 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:15.838803 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:15.839253 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:15.839257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:15.839259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:15.839829 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:15.840034 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:15.840726 (+ 692us) server_negotiation.cc:299] Negotiation successful
0807 06:17:15.841017 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":139,"threads_started":1}
I20260807 06:17:15.846524 27782 catalog_manager.cc:1347] Generated new cluster ID: b4102ab78ae449cba5802047df865617
I20260807 06:17:15.846592 27782 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:15.856416 27782 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:15.857288 27782 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:15.865396 27782 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d48ce753914a40f3b459c9b764c70798: Generated new TSK 0
I20260807 06:17:15.866075 27782 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:15.906368 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:16.033492 27798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:16.033736 27798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:16.033780 27798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:16.037904 27798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:16.037957 27798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:16.038014 27798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:16.043197 27798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:16.044142 27798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:16.045120 27798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:16.054519 27804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.054497 27805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.054533 27809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:16.055001 27798 server_base.cc:1034] running on GCE node
I20260807 06:17:16.055423 27798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:16.056035 27798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:16.057250 27798 hybrid_clock.cc:648] HybridClock initialized: now 1786083436057222 us; error 42 us; skew 500 ppm
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:16.060214 27798 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:16.061050 27798 webserver.cc:460] Webserver started at http://127.26.252.65:45647/ using document root <none> and password file <none>
I20260807 06:17:16.061612 27798 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:16.061705 27798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:16.061932 27798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:16.064051 27798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "d6a5dfb51f1b48fdb602d4d77f8fad3e"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "23a4b9af701bb904739aedafb70aacba"
server_key_iv: "16496aaf4f926d9c75958f4936e3071d"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.064613 27798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "d6a5dfb51f1b48fdb602d4d77f8fad3e"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "23a4b9af701bb904739aedafb70aacba"
server_key_iv: "16496aaf4f926d9c75958f4936e3071d"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.068452 27798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:16.070915 27818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.072100 27798 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:16.072265 27798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "d6a5dfb51f1b48fdb602d4d77f8fad3e"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "23a4b9af701bb904739aedafb70aacba"
server_key_iv: "16496aaf4f926d9c75958f4936e3071d"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.072372 27798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:16.090797 27798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:16.093653 27798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:16.093850 27798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:16.094478 27798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:16.095309 27798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:16.095387 27798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.095458 27798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:16.095506 27798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.104771 27798 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:39331
I20260807 06:17:16.104817 27973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:39331 every 8 connection(s)
I20260807 06:17:16.105691 27798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:16.113884 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27798
I20260807 06:17:16.114032 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:16.114348 27633 external_mini_cluster.cc:1428] Setting key 098e93855a31932e59b0c7859d208690
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:16.121572 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.107708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:55049 (local address 127.26.252.126:44723)
0807 06:17:16.107879 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:16.107884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:16.108983 (+ 1099us) server_negotiation.cc:407] Connection header received
0807 06:17:16.109827 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:16.109829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:16.109879 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:16.109964 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:16.111462 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.112095 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.113377 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.113719 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.113840 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.117080 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:16.117087 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:16.117093 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:16.117130 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:16.119040 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.119696 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.119699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.119700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.119787 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.120219 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.120227 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.120231 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.120518 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:16.120645 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:16.121120 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 06:17:16.121287 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:17:16.122272 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.108157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44723 (local address 127.26.252.65:55049)
0807 06:17:16.108827 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:16.108869 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:16.109611 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:16.110181 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:16.110189 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:16.110720 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:16.111304 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.111320 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.112226 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.112229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.113242 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.113253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.113902 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.113906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.114196 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.114850 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:16.114902 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:16.116898 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:16.119169 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.119179 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.119194 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.119563 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.119882 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.119886 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.119890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.120068 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.120647 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:16.120652 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:16.120872 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 06:17:16.121032 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 06:17:16.121381 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":120,"threads_started":1}
I20260807 06:17:16.123807 27974 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44723
I20260807 06:17:16.124042 27974 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:16.124570 27974 heartbeater.cc:511] Master 127.26.252.126:44723 requested a full tablet report, sending...
I20260807 06:17:16.126118 27710 ts_manager.cc:194] Registered new tserver with Master: d6a5dfb51f1b48fdb602d4d77f8fad3e (127.26.252.65:39331)
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:16.127333 27710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:55049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:16.145812 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:16.263410 27979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:16.263656 27979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:16.263700 27979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:16.267794 27979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:16.267858 27979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:16.267953 27979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:16.273340 27979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:16.274403 27979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:16.275525 27979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:16.285197 27985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.285209 27986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.285387 27988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:16.285480 27979 server_base.cc:1034] running on GCE node
I20260807 06:17:16.285980 27979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:16.286706 27979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:16.287910 27979 hybrid_clock.cc:648] HybridClock initialized: now 1786083436287868 us; error 53 us; skew 500 ppm
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:16.290858 27979 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:16.291750 27979 webserver.cc:460] Webserver started at http://127.26.252.66:39099/ using document root <none> and password file <none>
I20260807 06:17:16.292321 27979 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:16.292387 27979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:16.292599 27979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:16.294715 27979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "51cb9c09845946a386e13b76cbebc816"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "e0850915b2ff1957707f29580adcd93f"
server_key_iv: "7c3540b378c762f033b0e155b0164306"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.295313 27979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "51cb9c09845946a386e13b76cbebc816"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "e0850915b2ff1957707f29580adcd93f"
server_key_iv: "7c3540b378c762f033b0e155b0164306"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.299220 27979 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:17:16.301641 27998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.302958 27979 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:16.303092 27979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "51cb9c09845946a386e13b76cbebc816"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "e0850915b2ff1957707f29580adcd93f"
server_key_iv: "7c3540b378c762f033b0e155b0164306"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.303205 27979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:16.319092 27979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:16.322089 27979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:16.322299 27979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:16.322939 27979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:16.323791 27979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:16.323861 27979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.323931 27979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:16.323977 27979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.333693 27979 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:38731
I20260807 06:17:16.333730 28167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:38731 every 8 connection(s)
I20260807 06:17:16.334658 27979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:16.342793 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27979
I20260807 06:17:16.342886 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:16.343168 27633 external_mini_cluster.cc:1428] Setting key caaf233f98d5337d5a55037220f6f315
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:16.349742 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.336806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:36361 (local address 127.26.252.126:44723)
0807 06:17:16.336951 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:16.336955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:16.338688 (+ 1733us) server_negotiation.cc:407] Connection header received
0807 06:17:16.339538 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:16.339541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:16.339590 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:16.339695 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:16.340810 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.341409 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.342577 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.342834 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.342971 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.345722 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:16.345729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:16.345735 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:16.345782 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:16.347500 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.348159 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.348163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.348164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.348255 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.348634 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.348638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.348640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.348840 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:16.348953 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:16.349439 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 06:17:16.349562 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:17:16.350579 28170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.337315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44723 (local address 127.26.252.66:36361)
0807 06:17:16.338532 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:16.338575 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:16.339352 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:16.339829 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:16.339836 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:16.340193 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:16.340657 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.340669 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.341529 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.341532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.342459 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.342474 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.343076 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.343081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.343282 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.344004 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:16.344026 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:16.345551 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:16.347626 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.347633 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.347649 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.348026 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.348355 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.348358 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.348359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.348523 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.348954 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:16.348968 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:16.349199 (+ 231us) client_negotiation.cc:769] Sending connection context
0807 06:17:16.349392 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 06:17:16.349701 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"thread_start_us":127,"threads_started":1}
I20260807 06:17:16.351943 28168 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44723
I20260807 06:17:16.352173 28168 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:16.352658 28168 heartbeater.cc:511] Master 127.26.252.126:44723 requested a full tablet report, sending...
I20260807 06:17:16.353778 27710 ts_manager.cc:194] Registered new tserver with Master: 51cb9c09845946a386e13b76cbebc816 (127.26.252.66:38731)
I20260807 06:17:16.354753 27710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:36361
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:16.374212 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:16.495042 28175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:16.495312 28175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:16.495357 28175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:16.499305 28175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:16.499358 28175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:16.499416 28175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:16.504607 28175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44723
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:16.505635 28175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:16.506767 28175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:16.516553 28182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.516526 28185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:16.516592 28181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:16.516889 28175 server_base.cc:1034] running on GCE node
I20260807 06:17:16.517330 28175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:16.518016 28175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:16.519203 28175 hybrid_clock.cc:648] HybridClock initialized: now 1786083436519184 us; error 31 us; skew 500 ppm
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:16.522060 28175 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:16.522938 28175 webserver.cc:460] Webserver started at http://127.26.252.67:36139/ using document root <none> and password file <none>
I20260807 06:17:16.523465 28175 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:16.523527 28175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:16.523689 28175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:16.525666 28175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "935cfc29fb5c41d5acf5a47f5e66079c"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "60fe434148afbe17dd762a547fafbd01"
server_key_iv: "4700bac40c6abfa29f20b41beb9a239b"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.526190 28175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "935cfc29fb5c41d5acf5a47f5e66079c"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "60fe434148afbe17dd762a547fafbd01"
server_key_iv: "4700bac40c6abfa29f20b41beb9a239b"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.530030 28175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:17:16.532459 28195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.533675 28175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:16.533816 28175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "935cfc29fb5c41d5acf5a47f5e66079c"
format_stamp: "Formatted at 2026-08-07 06:17:16 on dist-test-slave-68xk"
server_key: "60fe434148afbe17dd762a547fafbd01"
server_key_iv: "4700bac40c6abfa29f20b41beb9a239b"
server_key_version: "encryptionkey@0"
I20260807 06:17:16.533917 28175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:16.548483 28175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:16.551487 28175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:16.551690 28175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:16.552289 28175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:16.553115 28175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:16.553162 28175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.553228 28175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:16.553264 28175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:16.562492 28175 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:37045
I20260807 06:17:16.562518 28358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:37045 every 8 connection(s)
I20260807 06:17:16.563388 28175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:16.570746 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 28175
I20260807 06:17:16.570919 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:16.571204 27633 external_mini_cluster.cc:1428] Setting key 4ad4696b6285943df75c007e5585972b
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:16.578145 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.565265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:40079 (local address 127.26.252.126:44723)
0807 06:17:16.565420 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:16.565425 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:16.566687 (+ 1262us) server_negotiation.cc:407] Connection header received
0807 06:17:16.567526 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:16.567530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:16.567582 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:16.567671 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:16.568879 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.569483 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.570897 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.571164 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.571278 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.574162 (+ 2884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:16.574167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:16.574170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:16.574240 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:16.575938 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.576664 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.576668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.576670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.576777 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.577150 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.577152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.577154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.577368 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:16.577450 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:16.577914 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 06:17:16.578021 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:17:16.579073 28361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.565698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44723 (local address 127.26.252.67:40079)
0807 06:17:16.566481 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:16.566536 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:16.567320 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:16.567841 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:16.567848 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:16.568260 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:16.568730 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.568743 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.569626 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.569628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.570752 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:16.570764 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.571325 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.571329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:16.571516 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.572100 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:16.572119 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:16.573999 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:16.576098 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.576104 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.576119 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.576535 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.576865 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:16.576867 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:16.576868 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:16.577063 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:16.577460 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:16.577465 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:16.577697 (+ 232us) client_negotiation.cc:769] Sending connection context
0807 06:17:16.577856 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 06:17:16.578112 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":120,"threads_started":1}
I20260807 06:17:16.580238 28359 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44723
I20260807 06:17:16.580483 28359 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:16.580978 28359 heartbeater.cc:511] Master 127.26.252.126:44723 requested a full tablet report, sending...
I20260807 06:17:16.582115 27710 ts_manager.cc:194] Registered new tserver with Master: 935cfc29fb5c41d5acf5a47f5e66079c (127.26.252.67:37045)
I20260807 06:17:16.582732 27710 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:40079
I20260807 06:17:16.586174 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:16.615485 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.604990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60244 (local address 127.26.252.65:39331)
0807 06:17:16.605341 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:16.605356 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:16.605468 (+ 112us) server_negotiation.cc:407] Connection header received
0807 06:17:16.605577 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:16.605582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:16.605802 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:16.605983 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:16.606842 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.607806 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.608615 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.608998 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.609094 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.611730 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:16.611740 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:16.611753 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:16.611779 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:16.613439 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.613926 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.613932 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.613933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.614021 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.614336 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.614341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.614343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.614651 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:16.614895 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:16.615108 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 06:17:16.615281 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":103,"threads_started":1}
W20260807 06:17:16.616515 27850 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60244
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[27652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:16.645004 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:16.635822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60256 (local address 127.26.252.65:39331)
0807 06:17:16.635957 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:16.635960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:16.636125 (+ 165us) server_negotiation.cc:407] Connection header received
0807 06:17:16.636268 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:16.636271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:16.636314 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:16.636381 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:16.637308 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.637899 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.638818 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:16.639052 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:16.639138 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:16.641840 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:16.641843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:16.641845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:16.641868 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:16.643394 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.643831 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.643834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.643835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.643917 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:16.644204 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:16.644207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:16.644209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:16.644392 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:16.644504 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:16.644752 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 06:17:16.644867 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:17:16.646101 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27798
I20260807 06:17:16.658552 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27979
I20260807 06:17:16.675937 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 28175
I20260807 06:17:16.698530 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27671
2026-08-07T06:17:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2519 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[28379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[28379](info): set up 2 sockets
Aug 07 06:17:16 dist-test-slave-68xk krb5kdc[28379](info): commencing operation
krb5kdc: starting...
W20260807 06:17:17.913149 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:18.047627 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:41619
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:41619
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:18.158480 28398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:18.158776 28398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:18.158861 28398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:18.162813 28398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:18.162900 28398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:18.162941 28398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:18.162995 28398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:18.163036 28398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:18.168219 28398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:41619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:41619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:18.169286 28398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:18.170324 28398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:18.178862 28405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.178874 28404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.178884 28407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:18.179174 28398 server_base.cc:1034] running on GCE node
I20260807 06:17:18.179791 28398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:18.180867 28398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:18.182056 28398 hybrid_clock.cc:648] HybridClock initialized: now 1786083438182033 us; error 41 us; skew 500 ppm
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:18.184849 28398 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:18.185724 28398 webserver.cc:460] Webserver started at http://127.26.252.126:40817/ using document root <none> and password file <none>
I20260807 06:17:18.186317 28398 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:18.186411 28398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:18.186669 28398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:18.188658 28398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "cca97c83db0a4040857607cf71cbb710"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "4c68e36011b368eb7d4d3525687850f4"
server_key_iv: "d9320aba4c0b34b6c834c559cba099e5"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.189222 28398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "cca97c83db0a4040857607cf71cbb710"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "4c68e36011b368eb7d4d3525687850f4"
server_key_iv: "d9320aba4c0b34b6c834c559cba099e5"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.193116 28398 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 06:17:18.195663 28416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.196836 28398 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:18.196983 28398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "cca97c83db0a4040857607cf71cbb710"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "4c68e36011b368eb7d4d3525687850f4"
server_key_iv: "d9320aba4c0b34b6c834c559cba099e5"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.197095 28398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:18.216552 28398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:18.219370 28398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:18.219570 28398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:18.226962 28398 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:41619
I20260807 06:17:18.226987 28489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:41619 every 8 connection(s)
I20260807 06:17:18.227890 28398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:18.230736 28490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:18.234081 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 28398
I20260807 06:17:18.234225 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:18.234570 27633 external_mini_cluster.cc:1428] Setting key 6642c94a3b9942c157671f0f42527ade
I20260807 06:17:18.236526 28490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710: Bootstrap starting.
I20260807 06:17:18.239017 28490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:18.239764 28490 log.cc:824] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:18.241878 28490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710: No bootstrap required, opened a new log
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:18.246003 28490 raft_consensus.cc:348] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } }
I20260807 06:17:18.246312 28490 raft_consensus.cc:374] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:18.246374 28490 raft_consensus.cc:729] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cca97c83db0a4040857607cf71cbb710, State: Initialized, Role: FOLLOWER
I20260807 06:17:18.246951 28490 consensus_queue.cc:260] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } }
I20260807 06:17:18.247119 28490 raft_consensus.cc:388] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:18.247192 28490 raft_consensus.cc:482] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:18.247320 28490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:18.248485 28490 raft_consensus.cc:504] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } }
I20260807 06:17:18.248867 28490 leader_election.cc:302] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cca97c83db0a4040857607cf71cbb710; no voters:
I20260807 06:17:18.249260 28490 leader_election.cc:288] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:18.249377 28497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:18.249650 28497 raft_consensus.cc:686] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [term 1 LEADER]: Becoming Leader. State: Replica: cca97c83db0a4040857607cf71cbb710, State: Running, Role: LEADER
I20260807 06:17:18.250046 28497 consensus_queue.cc:237] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } }
I20260807 06:17:18.250434 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.235998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32818 (local address 127.26.252.126:41619)
0807 06:17:18.236547 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:18.236579 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:18.236617 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:17:18.237269 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:18.237285 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:18.237605 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:18.237877 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:18.238800 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.239900 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.240955 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.241448 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.241567 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.244375 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:18.244381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:18.244399 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:18.244429 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:18.247054 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.247569 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.247578 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.247584 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.247723 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.248036 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.248040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.248041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.248608 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:18.248795 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:18.249077 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 06:17:18.249423 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"spinlock_wait_cycles":6016,"thread_start_us":137,"threads_started":1}
I20260807 06:17:18.250582 28490 sys_catalog.cc:564] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:18.251735 28498 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cca97c83db0a4040857607cf71cbb710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } } }
I20260807 06:17:18.251859 28498 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:18.252485 28501 sys_catalog.cc:455] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cca97c83db0a4040857607cf71cbb710. Latest consensus state: current_term: 1 leader_uuid: "cca97c83db0a4040857607cf71cbb710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cca97c83db0a4040857607cf71cbb710" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41619 } } }
I20260807 06:17:18.252643 28501 sys_catalog.cc:458] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:18.253001 28511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:18.256362 28511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:18.261659 28511 catalog_manager.cc:1347] Generated new cluster ID: 46d7b7c776d44b68bca66902da26571d
I20260807 06:17:18.261726 28511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:18.283146 28511 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:18.284116 28511 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:18.299988 28511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cca97c83db0a4040857607cf71cbb710: Generated new TSK 0
I20260807 06:17:18.300814 28511 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:18.330076 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:18.445775 28533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:18.446012 28533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:18.446084 28533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:18.450021 28533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:18.450078 28533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:18.450194 28533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:18.455633 28533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:18.456604 28533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:18.457600 28533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:18.466830 28545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.466890 28541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.466830 28543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:18.467051 28533 server_base.cc:1034] running on GCE node
I20260807 06:17:18.467545 28533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:18.468242 28533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:18.469409 28533 hybrid_clock.cc:648] HybridClock initialized: now 1786083438469389 us; error 31 us; skew 500 ppm
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:18.472281 28533 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:18.473131 28533 webserver.cc:460] Webserver started at http://127.26.252.65:43681/ using document root <none> and password file <none>
I20260807 06:17:18.473646 28533 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:18.473707 28533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:18.473866 28533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:18.475888 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "6b4ae955fc1343feb598149ed2053aaa"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "b57030321e031f44cff7a8d8887148fa"
server_key_iv: "4d0c46c18216c46d831850e22ed0fd67"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.476469 28533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "6b4ae955fc1343feb598149ed2053aaa"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "b57030321e031f44cff7a8d8887148fa"
server_key_iv: "4d0c46c18216c46d831850e22ed0fd67"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.480212 28533 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260807 06:17:18.482769 28554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.484041 28533 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:17:18.484241 28533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "6b4ae955fc1343feb598149ed2053aaa"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "b57030321e031f44cff7a8d8887148fa"
server_key_iv: "4d0c46c18216c46d831850e22ed0fd67"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.484361 28533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:18.494143 28533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:18.497465 28533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:18.497678 28533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:18.498271 28533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:18.499172 28533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:18.499248 28533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.499320 28533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:18.499361 28533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.508579 28533 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:44679
I20260807 06:17:18.508610 28717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:44679 every 8 connection(s)
I20260807 06:17:18.509483 28533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:18.516899 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 28533
I20260807 06:17:18.517015 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:18.517313 27633 external_mini_cluster.cc:1428] Setting key 9f5a1a183429356ee5dd82f2a25b62d0
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:18.523092 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.511291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:51483 (local address 127.26.252.126:41619)
0807 06:17:18.511425 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:18.511429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:18.512244 (+ 815us) server_negotiation.cc:407] Connection header received
0807 06:17:18.513483 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:18.513485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:18.513532 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:18.513616 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:18.514865 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.515435 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.516523 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.516743 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.516821 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.519605 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:18.519609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:18.519612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:18.519637 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:18.521055 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.521566 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.521574 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.521575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.521648 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.521990 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.521993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.521995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.522165 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:18.522273 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:18.522801 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 06:17:18.522922 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:18.523903 28722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.511632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41619 (local address 127.26.252.65:51483)
0807 06:17:18.512079 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:18.512123 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:18.513271 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:18.513782 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:18.513789 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:18.514126 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:18.514709 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.514724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.515545 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.515547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.516412 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.516421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.516901 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.516907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.517123 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.517789 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:18.517806 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:18.519446 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:18.521185 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.521191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.521205 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.521456 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.521747 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.521750 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.521752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.521891 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.522272 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:18.522279 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:18.522573 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 06:17:18.522759 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 06:17:18.523056 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":119,"threads_started":1}
I20260807 06:17:18.525156 28720 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41619
I20260807 06:17:18.525410 28720 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:18.526002 28720 heartbeater.cc:511] Master 127.26.252.126:41619 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:18.527633 28444 ts_manager.cc:194] Registered new tserver with Master: 6b4ae955fc1343feb598149ed2053aaa (127.26.252.65:44679)
I20260807 06:17:18.528949 28444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:51483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:18.546747 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:18.677078 28725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:18.677443 28725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:18.677512 28725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:18.681551 28725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:18.681615 28725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:18.681674 28725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:18.687084 28725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:18.688290 28725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:18.689370 28725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:18.699133 28734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.699151 28730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.699151 28731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:18.699234 28725 server_base.cc:1034] running on GCE node
I20260807 06:17:18.699896 28725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:18.700569 28725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:18.701771 28725 hybrid_clock.cc:648] HybridClock initialized: now 1786083438701741 us; error 37 us; skew 500 ppm
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:18.704609 28725 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:18.705466 28725 webserver.cc:460] Webserver started at http://127.26.252.66:45645/ using document root <none> and password file <none>
I20260807 06:17:18.706043 28725 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:18.706123 28725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:18.706359 28725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:18.708453 28725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "aa137e836bba4837a1c1f1689ced1225"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "34242aabff977155486f2e25612f7195"
server_key_iv: "03b369d067ac597555fc2c6c30d4bfba"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.709043 28725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "aa137e836bba4837a1c1f1689ced1225"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "34242aabff977155486f2e25612f7195"
server_key_iv: "03b369d067ac597555fc2c6c30d4bfba"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.712852 28725 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:18.715384 28743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.716574 28725 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:18.716717 28725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "aa137e836bba4837a1c1f1689ced1225"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "34242aabff977155486f2e25612f7195"
server_key_iv: "03b369d067ac597555fc2c6c30d4bfba"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.716822 28725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:18.727923 28725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:18.730748 28725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:18.730952 28725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:18.731536 28725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:18.732359 28725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:18.732430 28725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.732496 28725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:18.732542 28725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.741319 28725 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:40389
I20260807 06:17:18.741343 28906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:40389 every 8 connection(s)
I20260807 06:17:18.742190 28725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:18.744210 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 28725
I20260807 06:17:18.744333 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:18.744632 27633 external_mini_cluster.cc:1428] Setting key 1e0e0081d5bd5b7f6245040f4b055bbf
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:18.757428 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.744156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:40923 (local address 127.26.252.126:41619)
0807 06:17:18.744325 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:18.744330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:18.745371 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 06:17:18.746883 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:18.746886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:18.746939 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:18.747045 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:18.748228 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.748764 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.749946 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.750167 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.750292 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.753593 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:18.753602 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:18.753604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:18.753630 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:18.755154 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.755699 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.755704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.755706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.755793 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.756215 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.756220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.756222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.756420 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:18.756536 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:18.757055 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 06:17:18.757236 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:17:18.758312 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.744687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41619 (local address 127.26.252.66:40923)
0807 06:17:18.745210 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:18.745261 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:18.746670 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:18.747223 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:18.747231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:18.747598 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:18.748084 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.748097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.748898 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.748901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.749800 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.749810 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.750337 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.750341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.750572 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.751278 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:18.751299 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:18.753416 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:18.755280 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.755287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.755302 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.755587 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.755902 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.755906 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.755908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.756113 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.756535 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:18.756542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:18.756805 (+ 263us) client_negotiation.cc:769] Sending connection context
0807 06:17:18.757008 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 06:17:18.757391 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":149,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:17:18.759676 28907 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41619
I20260807 06:17:18.759927 28907 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:18.760457 28907 heartbeater.cc:511] Master 127.26.252.126:41619 requested a full tablet report, sending...
I20260807 06:17:18.761555 28444 ts_manager.cc:194] Registered new tserver with Master: aa137e836bba4837a1c1f1689ced1225 (127.26.252.66:40389)
I20260807 06:17:18.762180 28444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:40923
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:18.777693 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:39833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:18.894248 28914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:18.894558 28914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:18.894608 28914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:18.898922 28914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:18.898991 28914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:18.899055 28914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:18.904556 28914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:39833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41619
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:18.905619 28914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:18.906742 28914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:18.916719 28919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.916703 28922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:18.916693 28925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:18.917125 28914 server_base.cc:1034] running on GCE node
I20260807 06:17:18.917520 28914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:18.918145 28914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:18.919309 28914 hybrid_clock.cc:648] HybridClock initialized: now 1786083438919282 us; error 34 us; skew 500 ppm
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:18.922019 28914 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:18.922945 28914 webserver.cc:460] Webserver started at http://127.26.252.67:34693/ using document root <none> and password file <none>
I20260807 06:17:18.923519 28914 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:18.923615 28914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:18.923866 28914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:18.925933 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "f97ac923e77545cdb45fa1817713e38c"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "f76984e0f4fe9a1c1df15663fe07d18d"
server_key_iv: "d9901988a467eea7101aa5fb59a54df9"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.926570 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "f97ac923e77545cdb45fa1817713e38c"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "f76984e0f4fe9a1c1df15663fe07d18d"
server_key_iv: "d9901988a467eea7101aa5fb59a54df9"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.930315 28914 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:18.932840 28936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.934113 28914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:18.934247 28914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "f97ac923e77545cdb45fa1817713e38c"
format_stamp: "Formatted at 2026-08-07 06:17:18 on dist-test-slave-68xk"
server_key: "f76984e0f4fe9a1c1df15663fe07d18d"
server_key_iv: "d9901988a467eea7101aa5fb59a54df9"
server_key_version: "encryptionkey@0"
I20260807 06:17:18.934357 28914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:18.942937 28914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:18.946225 28914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:18.946451 28914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:18.947041 28914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:18.947960 28914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:18.948012 28914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.948078 28914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:18.948117 28914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:18.957358 28914 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:45277
I20260807 06:17:18.957417 29094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:45277 every 8 connection(s)
I20260807 06:17:18.958250 28914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:18.964294 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 28914
I20260807 06:17:18.964423 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:18.964682 27633 external_mini_cluster.cc:1428] Setting key dd43aecaded4b03637db7c49d42dfba7
Aug 07 06:17:18 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:18.971717 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.960154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:38327 (local address 127.26.252.126:41619)
0807 06:17:18.960302 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:18.960306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:18.961160 (+ 854us) server_negotiation.cc:407] Connection header received
0807 06:17:18.962463 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:18.962467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:18.962527 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:18.962613 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:18.963795 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.964339 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.965595 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.965815 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.965924 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.968473 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:18.968476 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:18.968478 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:18.968501 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:18.969788 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.970243 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.970246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.970247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.970317 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.970676 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.970679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.970680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.970845 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:18.970924 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:18.971483 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 06:17:18.971588 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:17:18.972533 29099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.960526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41619 (local address 127.26.252.67:38327)
0807 06:17:18.960981 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:18.961022 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:18.962234 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:18.962802 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:18.962809 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:18.963162 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:18.963642 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.963656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.964510 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.964513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.965453 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:18.965463 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.965967 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.965971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:18.966148 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.966810 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:18.966832 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:18.968321 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:18.969889 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.969894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.969905 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.970158 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.970395 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:18.970397 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:18.970398 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:18.970593 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:18.970936 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:18.970940 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:18.971224 (+ 284us) client_negotiation.cc:769] Sending connection context
0807 06:17:18.971387 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 06:17:18.971648 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
I20260807 06:17:18.973649 29096 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41619
I20260807 06:17:18.973903 29096 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:18.974400 29096 heartbeater.cc:511] Master 127.26.252.126:41619 requested a full tablet report, sending...
I20260807 06:17:18.975512 28444 ts_manager.cc:194] Registered new tserver with Master: f97ac923e77545cdb45fa1817713e38c (127.26.252.67:45277)
I20260807 06:17:18.976083 28444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:38327
I20260807 06:17:18.978654 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:17:18.989565 28494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:18.982093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32830 (local address 127.26.252.126:41619)
0807 06:17:18.982263 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:18.982268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:18.982480 (+ 212us) server_negotiation.cc:407] Connection header received
0807 06:17:18.982604 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:18.982606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:18.982644 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:18.982734 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:18.983405 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.983910 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.984660 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:18.984878 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:18.984952 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:18.986259 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:18.986261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:18.986263 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:18.986285 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:18.987810 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.988284 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.988286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.988288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.988371 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:18.988718 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:18.988720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:18.988721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:18.988927 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:18.989032 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:18.989347 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 06:17:18.989446 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 06:17:18.994292 28444 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:18.997463 28444 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:19.014693 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.006599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:45277 (local address 127.0.0.1:38094)
0807 06:17:19.007853 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:19.007911 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:19.008054 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:19.008937 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:19.008944 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:19.008997 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:19.009176 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.009191 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.011057 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.011061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.012626 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.012643 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.013990 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.013994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.014165 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.014228 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 06:17:19.014338 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:17:19.014498 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"mutex_wait_us":1,"thread_start_us":101,"threads_started":1}
I20260807 06:17:19.015796 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.006749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38094 (local address 127.26.252.67:45277)
0807 06:17:19.008313 (+ 1564us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.008328 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.008365 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:17:19.008475 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.008487 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.008725 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.009375 (+ 650us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:19.009589 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.010861 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.012815 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.013828 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.015286 (+ 1458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.015449 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.015514 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.015631 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1444,"thread_start_us":186,"threads_started":1}
I20260807 06:17:19.015831 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.007486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50182 (local address 127.26.252.66:40389)
0807 06:17:19.008070 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.008086 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.008888 (+ 802us) server_negotiation.cc:407] Connection header received
0807 06:17:19.010163 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.010171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.010370 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.010554 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:19.011033 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.012167 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.013777 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.014634 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.014735 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.015157 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.015542 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.015647 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":174,"threads_started":1}
I20260807 06:17:19.016039 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.007439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:44679 (local address 127.0.0.1:48900)
0807 06:17:19.009179 (+ 1740us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:19.009197 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:19.009285 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:19.009892 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:19.009895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:19.009913 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:19.010089 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.010098 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.012516 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.012519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.014090 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.014101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.015640 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.015643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.015726 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.015749 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:17:19.015830 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:17:19.015912 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1657,"thread_start_us":114,"threads_started":1}
I20260807 06:17:19.016168 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.008044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48900 (local address 127.26.252.65:44679)
0807 06:17:19.008389 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.008405 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.009403 (+ 998us) server_negotiation.cc:407] Connection header received
0807 06:17:19.009510 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.009517 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.009726 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.009890 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:19.010335 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.012299 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.014327 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.015326 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.015422 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.015578 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.015890 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.016007 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":143,"threads_started":1}
I20260807 06:17:19.016721 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.006888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:40389 (local address 127.0.0.1:50182)
0807 06:17:19.008745 (+ 1857us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:19.008762 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:19.008971 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:19.010757 (+ 1786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:19.010760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:19.010779 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:19.010888 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.010895 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.012358 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.012364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.013617 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.013628 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.015270 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.015274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.015373 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.015405 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 06:17:19.016503 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0807 06:17:19.016579 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1772,"thread_start_us":103,"threads_started":1}
I20260807 06:17:19.019146 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9c146081a14ee28829da1935af4578 (DEFAULT_TABLE table=test-table [id=f08841e2414d4b058788f32f7b3f2708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:19.019191 28624 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9c146081a14ee28829da1935af4578 (DEFAULT_TABLE table=test-table [id=f08841e2414d4b058788f32f7b3f2708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:19.019476 28817 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9c146081a14ee28829da1935af4578 (DEFAULT_TABLE table=test-table [id=f08841e2414d4b058788f32f7b3f2708]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:19.020342 28817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9c146081a14ee28829da1935af4578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:19.020336 28624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9c146081a14ee28829da1935af4578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:19.020334 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9c146081a14ee28829da1935af4578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:19.028297 29122 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: Bootstrap starting.
I20260807 06:17:19.028299 29125 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: Bootstrap starting.
I20260807 06:17:19.030206 29125 tablet_bootstrap.cc:654] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:19.030223 29122 tablet_bootstrap.cc:654] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:19.030798 29124 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: Bootstrap starting.
I20260807 06:17:19.031479 29122 log.cc:824] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:19.031533 29125 log.cc:824] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:19.032867 29124 tablet_bootstrap.cc:654] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:19.033677 29124 log.cc:824] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:19.033764 29122 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: No bootstrap required, opened a new log
I20260807 06:17:19.033751 29125 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: No bootstrap required, opened a new log
I20260807 06:17:19.033949 29122 ts_tablet_manager.cc:1397] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:17:19.033964 29125 ts_tablet_manager.cc:1397] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:17:19.035810 29124 tablet_bootstrap.cc:492] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: No bootstrap required, opened a new log
I20260807 06:17:19.036022 29124 ts_tablet_manager.cc:1397] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 06:17:19.037148 29122 raft_consensus.cc:348] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.037410 29122 raft_consensus.cc:374] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:19.037463 29122 raft_consensus.cc:729] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97ac923e77545cdb45fa1817713e38c, State: Initialized, Role: FOLLOWER
I20260807 06:17:19.037933 29122 consensus_queue.cc:260] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.038300 29125 raft_consensus.cc:348] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.038600 29125 raft_consensus.cc:374] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:19.038612 29096 heartbeater.cc:503] Master 127.26.252.126:41619 was elected leader, sending a full tablet report...
I20260807 06:17:19.038655 29125 raft_consensus.cc:729] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa137e836bba4837a1c1f1689ced1225, State: Initialized, Role: FOLLOWER
I20260807 06:17:19.038972 29122 ts_tablet_manager.cc:1428] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 06:17:19.039139 29125 consensus_queue.cc:260] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.039958 28907 heartbeater.cc:503] Master 127.26.252.126:41619 was elected leader, sending a full tablet report...
I20260807 06:17:19.040349 29125 ts_tablet_manager.cc:1428] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:17:19.041873 29124 raft_consensus.cc:348] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.042088 29124 raft_consensus.cc:374] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:19.042148 29124 raft_consensus.cc:729] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b4ae955fc1343feb598149ed2053aaa, State: Initialized, Role: FOLLOWER
I20260807 06:17:19.042618 29124 consensus_queue.cc:260] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.043376 28720 heartbeater.cc:503] Master 127.26.252.126:41619 was elected leader, sending a full tablet report...
I20260807 06:17:19.043609 29124 ts_tablet_manager.cc:1428] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 06:17:19.055493 29134 raft_consensus.cc:482] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:19.055656 29134 raft_consensus.cc:504] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.056740 29134 leader_election.cc:288] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b4ae955fc1343feb598149ed2053aaa (127.26.252.65:44679), aa137e836bba4837a1c1f1689ced1225 (127.26.252.66:40389)
I20260807 06:17:19.060861 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.057251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:49659 (local address 127.26.252.66:40389)
0807 06:17:19.057372 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.057377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.057393 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:17:19.057518 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.057524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.057582 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.057664 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:19.057977 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.058694 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.059872 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.060296 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.060422 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.060474 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.060667 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.060735 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:19.060861 29099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.056959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:40389 (local address 127.26.252.67:49659)
0807 06:17:19.057297 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:19.057316 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:19.057411 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:19.057691 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:19.057695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:19.057717 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:19.057857 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.057869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.058803 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.058809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.059742 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.059753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.060419 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.060423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.060534 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.060562 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:17:19.060648 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 06:17:19.060723 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256}
I20260807 06:17:19.061262 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.057143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:37843 (local address 127.26.252.65:44679)
0807 06:17:19.057267 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.057274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.057622 (+ 348us) server_negotiation.cc:407] Connection header received
0807 06:17:19.057749 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.057752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.057802 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.057898 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:19.058182 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.058951 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.060164 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.060608 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.060755 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.060806 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.061050 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.061131 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:17:19.061489 28847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9c146081a14ee28829da1935af4578" candidate_uuid: "f97ac923e77545cdb45fa1817713e38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa137e836bba4837a1c1f1689ced1225" is_pre_election: true
I20260807 06:17:19.061676 29142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.056959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:44679 (local address 127.26.252.67:37843)
0807 06:17:19.057487 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:19.057501 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:19.057645 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:19.057907 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:19.057909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:19.057942 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:19.058070 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.058076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.059081 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.059087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.060030 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:19.060041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.060739 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.060743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:19.060852 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.060875 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:17:19.061436 (+ 561us) client_negotiation.cc:240] Negotiation successful
0807 06:17:19.061510 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":60,"thread_start_us":125,"threads_started":1}
I20260807 06:17:19.061815 28847 raft_consensus.cc:2454] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97ac923e77545cdb45fa1817713e38c in term 0.
I20260807 06:17:19.062212 28653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9c146081a14ee28829da1935af4578" candidate_uuid: "f97ac923e77545cdb45fa1817713e38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4ae955fc1343feb598149ed2053aaa" is_pre_election: true
I20260807 06:17:19.062276 28939 leader_election.cc:302] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa137e836bba4837a1c1f1689ced1225, f97ac923e77545cdb45fa1817713e38c; no voters:
I20260807 06:17:19.062537 28653 raft_consensus.cc:2454] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97ac923e77545cdb45fa1817713e38c in term 0.
I20260807 06:17:19.062610 29134 raft_consensus.cc:2781] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:19.062708 29134 raft_consensus.cc:482] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:19.062770 29134 raft_consensus.cc:3037] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:19.063999 29134 raft_consensus.cc:504] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.064416 29134 leader_election.cc:288] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [CANDIDATE]: Term 1 election: Requested vote from peers 6b4ae955fc1343feb598149ed2053aaa (127.26.252.65:44679), aa137e836bba4837a1c1f1689ced1225 (127.26.252.66:40389)
I20260807 06:17:19.064792 28653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9c146081a14ee28829da1935af4578" candidate_uuid: "f97ac923e77545cdb45fa1817713e38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b4ae955fc1343feb598149ed2053aaa"
I20260807 06:17:19.064931 28653 raft_consensus.cc:3037] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:19.064980 28847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9c146081a14ee28829da1935af4578" candidate_uuid: "f97ac923e77545cdb45fa1817713e38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa137e836bba4837a1c1f1689ced1225"
I20260807 06:17:19.065155 28847 raft_consensus.cc:3037] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:19.066147 28653 raft_consensus.cc:2454] T 9a9c146081a14ee28829da1935af4578 P 6b4ae955fc1343feb598149ed2053aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97ac923e77545cdb45fa1817713e38c in term 1.
I20260807 06:17:19.066391 28847 raft_consensus.cc:2454] T 9a9c146081a14ee28829da1935af4578 P aa137e836bba4837a1c1f1689ced1225 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97ac923e77545cdb45fa1817713e38c in term 1.
I20260807 06:17:19.066545 28942 leader_election.cc:302] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b4ae955fc1343feb598149ed2053aaa, f97ac923e77545cdb45fa1817713e38c; no voters:
I20260807 06:17:19.066764 29134 raft_consensus.cc:2781] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:19.067006 29134 raft_consensus.cc:686] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [term 1 LEADER]: Becoming Leader. State: Replica: f97ac923e77545cdb45fa1817713e38c, State: Running, Role: LEADER
I20260807 06:17:19.067340 29134 consensus_queue.cc:237] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } }
I20260807 06:17:19.070792 28443 catalog_manager.cc:5495] T 9a9c146081a14ee28829da1935af4578 P f97ac923e77545cdb45fa1817713e38c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97ac923e77545cdb45fa1817713e38c (127.26.252.67). New cstate: current_term: 1 leader_uuid: "f97ac923e77545cdb45fa1817713e38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97ac923e77545cdb45fa1817713e38c" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b4ae955fc1343feb598149ed2053aaa" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa137e836bba4837a1c1f1689ced1225" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 40389 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:19.098037 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.088748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48910 (local address 127.26.252.65:44679)
0807 06:17:19.088885 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.088890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.089091 (+ 201us) server_negotiation.cc:407] Connection header received
0807 06:17:19.089252 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.089255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.089306 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.089401 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:19.090115 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.090720 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.091567 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.091804 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.091912 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.094526 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:19.094538 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:19.094552 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:19.094576 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:19.096263 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.096709 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.096715 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.096716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.096796 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.097079 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.097082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.097084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.097340 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:19.097558 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.097727 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.097855 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083439, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:19.126837 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.118782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48914 (local address 127.26.252.65:44679)
0807 06:17:19.118968 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.118972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.119045 (+ 73us) server_negotiation.cc:407] Connection header received
0807 06:17:19.119157 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.119160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.119206 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.119296 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:19.119938 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.120485 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.121381 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.121604 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.121685 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.124033 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:19.124036 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:19.124038 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:19.124060 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:19.125293 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.125659 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.125661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.125663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.125733 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.125974 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.125980 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.125981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.126148 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:19.126267 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.126528 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.126628 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[28379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[28379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:19.153151 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:19.144493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48918 (local address 127.26.252.65:44679)
0807 06:17:19.144648 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:19.144652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:19.144716 (+ 64us) server_negotiation.cc:407] Connection header received
0807 06:17:19.144825 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:19.144827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:19.144868 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:19.144936 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:19.145654 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.146133 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.147152 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:19.147373 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:19.147452 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:19.149907 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:19.149910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:19.149912 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:19.149934 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:19.151356 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.151961 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.151966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.151968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.152050 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:19.152339 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:19.152341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:19.152343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:19.152493 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:19.152591 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:19.152838 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 06:17:19.152932 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260807 06:17:19.154579 28595 tablet_service.cc:2908] Rejecting scan request for tablet 9a9c146081a14ee28829da1935af4578: Uninitialized: clean time has not yet been initialized
I20260807 06:17:19.156796 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 28533
I20260807 06:17:19.168851 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 28725
I20260807 06:17:19.181435 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 28914
I20260807 06:17:19.195189 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 28398
2026-08-07T06:17:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2496 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[29163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[29163](info): set up 2 sockets
Aug 07 06:17:19 dist-test-slave-68xk krb5kdc[29163](info): commencing operation
krb5kdc: starting...
W20260807 06:17:20.418032 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:20 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:20.545610 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44909
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44909
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:20.658932 29186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:20.659185 29186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:20.659226 29186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:20.663314 29186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:20.663367 29186 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:17:20.663389 29186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:20.663407 29186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:20.663441 29186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:20.663476 29186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:20.668718 29186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44909
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:20.669771 29186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:20.670827 29186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:17:20.679219 29186 server_base.cc:1034] running on GCE node
W20260807 06:17:20.679183 29191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:20.679284 29192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:20.679170 29195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:20.680047 29186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:20.681124 29186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:20.682333 29186 hybrid_clock.cc:648] HybridClock initialized: now 1786083440682318 us; error 27 us; skew 500 ppm
Aug 07 06:17:20 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:20.685066 29186 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:20.685967 29186 webserver.cc:460] Webserver started at http://127.26.252.126:36781/ using document root <none> and password file <none>
I20260807 06:17:20.686592 29186 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:20.686661 29186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:20.686838 29186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:20.688799 29186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "e72e867fd6a246a2855cfdbd18155fea"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "d1c592375a735cb1df75853b960bb69f"
server_key_iv: "ba9d6664bc6a90fdb66535c0fac7f784"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.689306 29186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "e72e867fd6a246a2855cfdbd18155fea"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "d1c592375a735cb1df75853b960bb69f"
server_key_iv: "ba9d6664bc6a90fdb66535c0fac7f784"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.692977 29186 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:20.695488 29204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:20.696873 29186 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:20.696991 29186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "e72e867fd6a246a2855cfdbd18155fea"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "d1c592375a735cb1df75853b960bb69f"
server_key_iv: "ba9d6664bc6a90fdb66535c0fac7f784"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.697075 29186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:20.721921 29186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:20.725337 29186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:20.725497 29186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:20.733768 29186 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44909
I20260807 06:17:20.733798 29286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44909 every 8 connection(s)
I20260807 06:17:20.734741 29186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:20.737552 29292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:20.742094 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 29186
I20260807 06:17:20.742192 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:20.742544 27633 external_mini_cluster.cc:1428] Setting key fbefb81d7059769bf55faf11bc219cb5
I20260807 06:17:20.743417 29292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Bootstrap starting.
I20260807 06:17:20.746364 29292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:20.747367 29292 log.cc:824] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:20.749461 29292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: No bootstrap required, opened a new log
Aug 07 06:17:20 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:20.753338 29292 raft_consensus.cc:348] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } }
I20260807 06:17:20.753659 29292 raft_consensus.cc:374] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:20.753723 29292 raft_consensus.cc:729] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e72e867fd6a246a2855cfdbd18155fea, State: Initialized, Role: FOLLOWER
I20260807 06:17:20.754261 29292 consensus_queue.cc:260] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } }
I20260807 06:17:20.754451 29292 raft_consensus.cc:388] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:20.754513 29292 raft_consensus.cc:482] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:20.754612 29292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:20.755743 29292 raft_consensus.cc:504] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } }
I20260807 06:17:20.756112 29292 leader_election.cc:302] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e72e867fd6a246a2855cfdbd18155fea; no voters:
I20260807 06:17:20.756510 29292 leader_election.cc:288] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:20.756613 29298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:20.756879 29298 raft_consensus.cc:686] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [term 1 LEADER]: Becoming Leader. State: Replica: e72e867fd6a246a2855cfdbd18155fea, State: Running, Role: LEADER
I20260807 06:17:20.757246 29298 consensus_queue.cc:237] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } }
I20260807 06:17:20.757853 29292 sys_catalog.cc:564] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:20.758498 29298 sys_catalog.cc:455] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e72e867fd6a246a2855cfdbd18155fea. Latest consensus state: current_term: 1 leader_uuid: "e72e867fd6a246a2855cfdbd18155fea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } } }
I20260807 06:17:20.758718 29298 sys_catalog.cc:458] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:20.758909 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:20.744037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.26.252.126:44909)
0807 06:17:20.744492 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:20.744513 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:20.744565 (+ 52us) server_negotiation.cc:407] Connection header received
0807 06:17:20.745410 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:20.745434 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:20.745984 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:20.746372 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:20.747167 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:20.748557 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:20.749426 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:20.750117 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:20.750288 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:20.752884 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:20.752890 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:20.752907 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:20.752939 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:20.755074 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:20.755606 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:20.755615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:20.755623 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:20.755774 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:20.756087 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:20.756091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:20.756092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:20.756641 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:20.757418 (+ 777us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:20.757579 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 06:17:20.757875 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":121,"threads_started":1}
I20260807 06:17:20.758946 29299 sys_catalog.cc:455] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e72e867fd6a246a2855cfdbd18155fea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e72e867fd6a246a2855cfdbd18155fea" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44909 } } }
I20260807 06:17:20.759038 29299 sys_catalog.cc:458] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea [sys.catalog]: This master's current role is: LEADER
W20260807 06:17:20.762645 29323 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:17:20.762727 29323 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:17:20.762804 29314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:20.763646 29314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:20.769285 29314 catalog_manager.cc:1347] Generated new cluster ID: accfaea783aa48f5b6e281b9c631dba4
I20260807 06:17:20.769356 29314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:20.785713 29314 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:20.787021 29314 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:20.794023 29314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Generated new TSK 0
I20260807 06:17:20.794917 29314 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:20.829289 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44909
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:20.944263 29334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:20.944566 29334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:20.944644 29334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:20.948644 29334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:20.948740 29334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:20.948809 29334 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:20.948887 29334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:20.954107 29334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:44909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:20.955217 29334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:20.956277 29334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:20.966146 29343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:20.966158 29340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:20.966280 29341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:20.966339 29334 server_base.cc:1034] running on GCE node
I20260807 06:17:20.966884 29334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:20.967514 29334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:20.968703 29334 hybrid_clock.cc:648] HybridClock initialized: now 1786083440968673 us; error 46 us; skew 500 ppm
Aug 07 06:17:20 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:20.971541 29334 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:20.972430 29334 webserver.cc:460] Webserver started at http://127.26.252.65:33309/ using document root <none> and password file <none>
I20260807 06:17:20.973002 29334 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:20.973093 29334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:20.973326 29334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:20.975448 29334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "aae130593f1342d48384124382555be8"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "6343d523456292ebcf00e31a88b1c17d"
server_key_iv: "0e80e16e3f6d2c0ef3b3bd91b79a1258"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.976024 29334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "aae130593f1342d48384124382555be8"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "6343d523456292ebcf00e31a88b1c17d"
server_key_iv: "0e80e16e3f6d2c0ef3b3bd91b79a1258"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.979854 29334 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:17:20.982373 29350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:20.983695 29334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:20.983845 29334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "aae130593f1342d48384124382555be8"
format_stamp: "Formatted at 2026-08-07 06:17:20 on dist-test-slave-68xk"
server_key: "6343d523456292ebcf00e31a88b1c17d"
server_key_iv: "0e80e16e3f6d2c0ef3b3bd91b79a1258"
server_key_version: "encryptionkey@0"
I20260807 06:17:20.983955 29334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:21.011910 29334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:21.015350 29334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:21.015524 29334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:21.016957 29334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:21.017009 29334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:21.017079 29334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:21.017112 29334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:21.033308 29334 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:37525
I20260807 06:17:21.033344 29512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:37525 every 8 connection(s)
I20260807 06:17:21.034610 29334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:21.036099 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.018009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:38295 (local address 127.26.252.126:44909)
0807 06:17:21.018135 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.018139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.019388 (+ 1249us) server_negotiation.cc:407] Connection header received
0807 06:17:21.020762 (+ 1374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.020766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.020841 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.020930 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.022874 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.023760 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.025704 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.026311 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.026554 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.031324 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.031330 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.031335 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.031369 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.033590 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.034268 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.034272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.034274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.034379 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.034843 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.034846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.034848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.035120 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.035226 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.035853 (+ 627us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.035972 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:17:21.037007 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.018618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.65:38295)
0807 06:17:21.019206 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.019270 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.020498 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.021353 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.021365 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.021887 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.022638 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.022662 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.023971 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.023974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.025499 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.025513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.026573 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.026580 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.026818 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.027462 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.027487 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.031105 (+ 3618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.033731 (+ 2626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.033739 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.033757 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.034162 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.034524 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.034527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.034529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.034705 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.035280 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.035287 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.035581 (+ 294us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.035794 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.036115 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":155,"threads_started":1}
I20260807 06:17:21.038515 29515 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44909
I20260807 06:17:21.038674 29515 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:21.039165 29515 heartbeater.cc:511] Master 127.26.252.126:44909 requested a full tablet report, sending...
I20260807 06:17:21.040776 29225 ts_manager.cc:194] Registered new tserver with Master: aae130593f1342d48384124382555be8 (127.26.252.65:37525)
I20260807 06:17:21.041919 29225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:38295
I20260807 06:17:21.043454 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 29334
I20260807 06:17:21.043730 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:21.044073 27633 external_mini_cluster.cc:1428] Setting key 4969ff096f48b8c1e52ac930a29beb57
I20260807 06:17:21.050535 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.040799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56535 (local address 127.26.252.126:44909)
0807 06:17:21.040919 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.040924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.042682 (+ 1758us) server_negotiation.cc:407] Connection header received
0807 06:17:21.042845 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.042849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.042896 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.042947 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.043558 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.044298 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.045268 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.045593 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.045684 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.047010 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.047013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.047015 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.047037 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.048784 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.049224 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.049227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.049228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.049338 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.049661 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.049663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.049664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.049831 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.049917 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.050226 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.050351 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:17:21.050704 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.040706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.65:56535)
0807 06:17:21.042598 (+ 1892us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.042613 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.042714 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.043082 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.043084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.043303 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.043416 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.043423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.044470 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.044472 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.045131 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.045140 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.045717 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.045721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.045816 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.046339 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.046359 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.046876 (+ 517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.048898 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.048901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.048902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.049096 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.049442 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.049448 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.049453 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.049562 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.049939 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.049945 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.050059 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.050179 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.050364 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1801,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:21.074024 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44909
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:21.189442 29526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:21.189728 29526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:21.189802 29526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:21.193897 29526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:21.193991 29526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:21.194069 29526 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:21.194145 29526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:21.199800 29526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:44909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:21.200958 29526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:21.202077 29526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:21.212524 29543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:21.212517 29542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:21.212517 29547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:21.212780 29526 server_base.cc:1034] running on GCE node
I20260807 06:17:21.213292 29526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:21.213966 29526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:21.215179 29526 hybrid_clock.cc:648] HybridClock initialized: now 1786083441215155 us; error 34 us; skew 500 ppm
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:21.218314 29526 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:21.219197 29526 webserver.cc:460] Webserver started at http://127.26.252.66:35697/ using document root <none> and password file <none>
I20260807 06:17:21.219729 29526 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:21.219789 29526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:21.219962 29526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:21.222038 29526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "ebc53755fa49405191dd469a10396d81"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "77228af3af686c5f66d371bdfe367a00"
server_key_iv: "4e5b813fec861fc8b97f5441e2284e28"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.222671 29526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "ebc53755fa49405191dd469a10396d81"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "77228af3af686c5f66d371bdfe367a00"
server_key_iv: "4e5b813fec861fc8b97f5441e2284e28"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.226579 29526 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:21.229700 29556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:21.231278 29526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:21.231433 29526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "ebc53755fa49405191dd469a10396d81"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "77228af3af686c5f66d371bdfe367a00"
server_key_iv: "4e5b813fec861fc8b97f5441e2284e28"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.231587 29526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:21.245347 29526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:21.248660 29526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:21.248873 29526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:21.250478 29526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:21.250550 29526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:21.250627 29526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:21.250675 29526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:21.262857 29526 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:37255
I20260807 06:17:21.262898 29733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:37255 every 8 connection(s)
I20260807 06:17:21.263808 29526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:21.267159 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.251442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:45253 (local address 127.26.252.126:44909)
0807 06:17:21.251630 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.251637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.252573 (+ 936us) server_negotiation.cc:407] Connection header received
0807 06:17:21.254062 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.254068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.254139 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.254262 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.256067 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.257031 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.259243 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.259585 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.259695 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.263071 (+ 3376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.263093 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.263096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.263128 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.264909 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.265456 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.265460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.265462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.265554 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.265924 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.265927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.265929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.266126 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.266237 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.266811 (+ 574us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.266940 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:17:21.267916 29569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.251843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.66:45253)
0807 06:17:21.252376 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.252442 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.253713 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.254534 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.254546 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.255102 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.255871 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.255898 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.257186 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.257193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.259075 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.259088 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.259787 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.259793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.260038 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.260793 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.260822 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.262892 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.265025 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.265031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.265054 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.265338 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.265651 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.265658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.265662 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.265813 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.266237 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.266245 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.266556 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.266745 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.267076 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":118,"threads_started":1}
I20260807 06:17:21.269207 29734 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44909
I20260807 06:17:21.269393 29734 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:21.269905 29734 heartbeater.cc:511] Master 127.26.252.126:44909 requested a full tablet report, sending...
I20260807 06:17:21.271092 29227 ts_manager.cc:194] Registered new tserver with Master: ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255)
I20260807 06:17:21.271961 29227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:45253
I20260807 06:17:21.272140 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 29526
I20260807 06:17:21.272261 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:21.272550 27633 external_mini_cluster.cc:1428] Setting key 5d08a0d9854246754cf95b97d41c502a
I20260807 06:17:21.280015 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.271632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57351 (local address 127.26.252.126:44909)
0807 06:17:21.271760 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.271764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.271981 (+ 217us) server_negotiation.cc:407] Connection header received
0807 06:17:21.272185 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.272189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.272246 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.272333 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.273208 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.273751 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.274797 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.275207 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.275343 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.276559 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.276564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.276566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.276592 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.278131 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.278682 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.278689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.278693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.278778 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.279083 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.279088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.279089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.279317 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.279436 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.279713 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.279828 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:17:21.280025 29742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.271513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.66:57351)
0807 06:17:21.271890 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.271904 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.272026 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.272676 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.272679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.272901 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.273079 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.273088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.273891 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.273894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.274672 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.274683 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.275325 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.275328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.275401 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.275945 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.275958 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.276418 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.278261 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.278268 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.278270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.278575 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.278887 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.278890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.278892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.278987 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.279430 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.279434 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.279537 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.279653 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.279815 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":6,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:21.305792 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44909
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:21.419176 29745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:21.419467 29745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:21.419514 29745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:21.423556 29745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:21.423610 29745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:21.423648 29745 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:21.423681 29745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:21.428844 29745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:44909
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:21.429796 29745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:21.430788 29745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:17:21.440660 29745 server_base.cc:1034] running on GCE node
W20260807 06:17:21.440653 29755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:21.440653 29758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:21.440670 29753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:21.441325 29745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:21.441995 29745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:21.443198 29745 hybrid_clock.cc:648] HybridClock initialized: now 1786083441443166 us; error 45 us; skew 500 ppm
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:21.445995 29745 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:21.446936 29745 webserver.cc:460] Webserver started at http://127.26.252.67:33933/ using document root <none> and password file <none>
I20260807 06:17:21.447502 29745 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:21.447595 29745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:21.447822 29745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:21.449838 29745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "2d07acf8edef4cfd882fb023a00054d5"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "b6e5cd562b430abe3257d2d5884668f5"
server_key_iv: "9a0959c086ff5f5fed4a4b21a512d06a"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.450457 29745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "2d07acf8edef4cfd882fb023a00054d5"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "b6e5cd562b430abe3257d2d5884668f5"
server_key_iv: "9a0959c086ff5f5fed4a4b21a512d06a"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.454282 29745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:17:21.456758 29769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:21.458005 29745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:21.458137 29745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "2d07acf8edef4cfd882fb023a00054d5"
format_stamp: "Formatted at 2026-08-07 06:17:21 on dist-test-slave-68xk"
server_key: "b6e5cd562b430abe3257d2d5884668f5"
server_key_iv: "9a0959c086ff5f5fed4a4b21a512d06a"
server_key_version: "encryptionkey@0"
I20260807 06:17:21.458279 29745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:21.479105 29745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:21.481926 29745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:21.482129 29745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:21.483701 29745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:21.483773 29745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:21.483841 29745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:21.483888 29745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:21.494761 29745 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:37559
I20260807 06:17:21.494890 29930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:37559 every 8 connection(s)
I20260807 06:17:21.495894 29745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:21.498606 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.484472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:36095 (local address 127.26.252.126:44909)
0807 06:17:21.484636 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.484641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.485992 (+ 1351us) server_negotiation.cc:407] Connection header received
0807 06:17:21.487434 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.487436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.487487 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.487619 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.489045 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.489599 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.490832 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.491054 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.491171 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.494784 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.494791 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.494795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.494829 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.496350 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.496971 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.496974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.496975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.497058 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.497441 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.497444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.497445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.497624 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.497702 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.498316 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.498477 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:17:21.499526 29778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.485306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.67:36095)
0807 06:17:21.485817 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.485878 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.487205 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.487831 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.487840 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.488304 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.488900 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.488923 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.489738 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.489742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.490709 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.490719 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.491232 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.491237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.491438 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.492744 (+ 1306us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.492771 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.494609 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.496493 (+ 1884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.496498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.496511 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.496843 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.497176 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.497179 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.497181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.497342 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.497720 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.497726 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.498040 (+ 314us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.498235 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.498568 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":111,"threads_started":1}
I20260807 06:17:21.500785 29932 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44909
I20260807 06:17:21.501019 29932 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:21.501634 29932 heartbeater.cc:511] Master 127.26.252.126:44909 requested a full tablet report, sending...
I20260807 06:17:21.502846 29225 ts_manager.cc:194] Registered new tserver with Master: 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67:37559)
I20260807 06:17:21.502969 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 29745
I20260807 06:17:21.503129 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:21.503413 27633 external_mini_cluster.cc:1428] Setting key 9ccfe77c01692094187df8ffa26c42df
I20260807 06:17:21.503644 29225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:36095
I20260807 06:17:21.505455 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:17:21.512089 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.504234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:43527 (local address 127.26.252.126:44909)
0807 06:17:21.504540 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.504546 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.504648 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:17:21.504774 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.504777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.504820 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.504911 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.505415 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.506016 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.506970 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.507228 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.507343 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.508785 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.508788 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.508790 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.508812 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.510242 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.510875 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.510878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.510879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.510955 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.511296 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.511299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.511300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.511461 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.511541 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.511874 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.511962 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228}
I20260807 06:17:21.512303 29941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.504218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.26.252.67:43527)
0807 06:17:21.504550 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.504564 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.504688 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.504930 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.504933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.505165 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.505294 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.505301 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.506155 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.506159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.506844 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.506853 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.507349 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.507352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.507457 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.508026 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.508045 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.508610 (+ 565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.510392 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.510399 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.510405 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.510768 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.511058 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.511064 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.511068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.511187 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.511567 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.511571 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.511701 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.511833 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.511993 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":4,"thread_start_us":152,"threads_started":1}
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:21.534150 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.526235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35086 (local address 127.26.252.126:44909)
0807 06:17:21.526348 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.526351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.526363 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:17:21.526397 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.526399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.526481 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.526550 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.527293 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.527786 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.528661 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.528871 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.528940 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.531437 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.531440 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.531442 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.531466 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.532692 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.533070 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.533073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.533074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.533182 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.533412 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.533414 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.533415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.533589 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.533701 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.533898 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.533992 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:17:21.537110 29225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:21.540473 29225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:21.555352 29962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.549366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:37525 (local address 127.0.0.1:43132)
0807 06:17:21.549932 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.549944 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.550023 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.551267 (+ 1244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.551270 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.551290 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.551377 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.551383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552751 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.552754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.553846 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.553857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.554964 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.555054 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.555104 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.555160 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.555211 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":51,"thread_start_us":100,"threads_started":1}
I20260807 06:17:21.555512 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.549803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43132 (local address 127.26.252.65:37525)
0807 06:17:21.550691 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.550698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.550717 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:17:21.550783 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.550787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.550947 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.551101 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.551520 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552606 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.553994 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.554819 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.555108 (+ 289us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.555233 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.555276 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.555341 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":74,"threads_started":1}
I20260807 06:17:21.555667 29959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.549184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51770 (local address 127.26.252.66:37255)
0807 06:17:21.550302 (+ 1118us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.550315 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.550341 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:17:21.550454 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.550460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.550671 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.550833 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.551144 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552391 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554000 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.554668 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554792 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.554968 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.555423 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.555539 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":986,"thread_start_us":136,"threads_started":1}
I20260807 06:17:21.555351 29958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.548975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:37255 (local address 127.0.0.1:51770)
0807 06:17:21.549489 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.549540 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.549682 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.550826 (+ 1144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.550832 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.550855 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.550983 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.550990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552504 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.552507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.553852 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.553863 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.554795 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.554904 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.554945 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.555055 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.555183 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":25,"thread_start_us":86,"threads_started":1}
I20260807 06:17:21.556411 29964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.549717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:37559 (local address 127.0.0.1:51224)
0807 06:17:21.550462 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.550475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.550575 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.551254 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.551256 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.551272 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.551362 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.551366 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552314 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.552318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.553945 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.553954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.555051 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.555054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.556096 (+ 1042us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.556122 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.556195 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.556282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":78,"spinlock_wait_cycles":6528,"thread_start_us":90,"threads_started":1}
I20260807 06:17:21.556840 29966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.550068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51224 (local address 127.26.252.67:37559)
0807 06:17:21.550402 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.550437 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.550669 (+ 232us) server_negotiation.cc:407] Connection header received
0807 06:17:21.550763 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.550769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.550947 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.551103 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.551474 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.552189 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554041 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.554819 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.554940 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.555097 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.556571 (+ 1474us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.556676 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":107,"threads_started":1}
I20260807 06:17:21.558897 29635 tablet_service.cc:1467] Processing CreateTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc (DEFAULT_TABLE table=test-table [id=ec70ad9d0cfc43babb520d28455466b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.558887 29421 tablet_service.cc:1467] Processing CreateTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc (DEFAULT_TABLE table=test-table [id=ec70ad9d0cfc43babb520d28455466b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.559299 29828 tablet_service.cc:1467] Processing CreateTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc (DEFAULT_TABLE table=test-table [id=ec70ad9d0cfc43babb520d28455466b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.560014 29421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f8b6d1e1a74364af32e2b8b5675dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.560014 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f8b6d1e1a74364af32e2b8b5675dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.560334 29828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f8b6d1e1a74364af32e2b8b5675dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.567310 29969 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Bootstrap starting.
I20260807 06:17:21.568425 29970 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Bootstrap starting.
I20260807 06:17:21.568907 29972 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Bootstrap starting.
I20260807 06:17:21.569794 29969 tablet_bootstrap.cc:654] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.570624 29969 log.cc:824] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:21.570818 29972 tablet_bootstrap.cc:654] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.571636 29972 log.cc:824] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:21.572319 29970 tablet_bootstrap.cc:654] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.572798 29969 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: No bootstrap required, opened a new log
I20260807 06:17:21.573002 29969 ts_tablet_manager.cc:1397] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:17:21.573122 29970 log.cc:824] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:21.573704 29972 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: No bootstrap required, opened a new log
I20260807 06:17:21.573918 29972 ts_tablet_manager.cc:1397] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 06:17:21.575147 29970 tablet_bootstrap.cc:492] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: No bootstrap required, opened a new log
I20260807 06:17:21.575412 29970 ts_tablet_manager.cc:1397] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 06:17:21.576385 29969 raft_consensus.cc:348] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.576625 29969 raft_consensus.cc:374] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.576680 29969 raft_consensus.cc:729] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d07acf8edef4cfd882fb023a00054d5, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.577155 29969 consensus_queue.cc:260] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.578128 29969 ts_tablet_manager.cc:1428] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 06:17:21.577948 29972 raft_consensus.cc:348] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.578218 29972 raft_consensus.cc:374] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.578287 29972 raft_consensus.cc:729] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc53755fa49405191dd469a10396d81, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.578557 29932 heartbeater.cc:503] Master 127.26.252.126:44909 was elected leader, sending a full tablet report...
I20260807 06:17:21.578776 29972 consensus_queue.cc:260] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.579465 29734 heartbeater.cc:503] Master 127.26.252.126:44909 was elected leader, sending a full tablet report...
I20260807 06:17:21.579741 29972 ts_tablet_manager.cc:1428] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:17:21.580718 29970 raft_consensus.cc:348] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.580906 29970 raft_consensus.cc:374] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.580973 29970 raft_consensus.cc:729] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae130593f1342d48384124382555be8, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.581380 29970 consensus_queue.cc:260] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.582191 29970 ts_tablet_manager.cc:1428] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 06:17:21.582561 29515 heartbeater.cc:503] Master 127.26.252.126:44909 was elected leader, sending a full tablet report...
I20260807 06:17:21.690624 29978 raft_consensus.cc:482] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:21.690842 29978 raft_consensus.cc:504] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.692008 29978 leader_election.cc:288] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255), aae130593f1342d48384124382555be8 (127.26.252.65:37525)
I20260807 06:17:21.696650 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.692521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:48807 (local address 127.26.252.65:37525)
0807 06:17:21.692642 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.692646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.692674 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:17:21.692806 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.692826 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.692887 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.692986 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.693307 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.693979 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.695433 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.696010 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.696142 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.696197 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.696436 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.696522 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:17:21.696661 29778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.692330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:37525 (local address 127.26.252.67:48807)
0807 06:17:21.692562 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.692580 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.692683 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.693005 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.693007 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.693022 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.693179 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.693187 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.694093 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.694096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.695285 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.695297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.696170 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.696174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.696298 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.696320 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.696396 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.696507 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260807 06:17:21.697010 29981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.692330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:37255 (local address 127.26.252.67:58401)
0807 06:17:21.692745 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.692761 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.692854 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.693092 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.693095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.693107 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.693550 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.693559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.694516 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.694520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.695589 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.695597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.696520 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.696524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.696631 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.696654 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.696738 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.696838 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":42,"thread_start_us":131,"threads_started":1}
I20260807 06:17:21.697305 29959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.692442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58401 (local address 127.26.252.66:37255)
0807 06:17:21.692601 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.692606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.692851 (+ 245us) server_negotiation.cc:407] Connection header received
0807 06:17:21.692934 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.692940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.692996 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.693069 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.693679 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.694377 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.695722 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.696358 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.696502 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.696547 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.697078 (+ 531us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.697172 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:17:21.697453 29426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f8b6d1e1a74364af32e2b8b5675dbc" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae130593f1342d48384124382555be8" is_pre_election: true
I20260807 06:17:21.697820 29426 raft_consensus.cc:2454] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 0.
I20260807 06:17:21.697875 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f8b6d1e1a74364af32e2b8b5675dbc" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81" is_pre_election: true
I20260807 06:17:21.698172 29658 raft_consensus.cc:2454] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 0.
I20260807 06:17:21.698391 29773 leader_election.cc:302] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d07acf8edef4cfd882fb023a00054d5, aae130593f1342d48384124382555be8; no voters:
I20260807 06:17:21.698750 29978 raft_consensus.cc:2781] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:21.698841 29978 raft_consensus.cc:482] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:21.698874 29978 raft_consensus.cc:3037] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.699965 29978 raft_consensus.cc:504] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.700367 29978 leader_election.cc:288] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 election: Requested vote from peers ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255), aae130593f1342d48384124382555be8 (127.26.252.65:37525)
I20260807 06:17:21.700706 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f8b6d1e1a74364af32e2b8b5675dbc" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81"
I20260807 06:17:21.700762 29426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f8b6d1e1a74364af32e2b8b5675dbc" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae130593f1342d48384124382555be8"
I20260807 06:17:21.700821 29658 raft_consensus.cc:3037] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.700911 29426 raft_consensus.cc:3037] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.702167 29426 raft_consensus.cc:2454] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 1.
I20260807 06:17:21.702481 29658 raft_consensus.cc:2454] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 1.
I20260807 06:17:21.702535 29773 leader_election.cc:302] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d07acf8edef4cfd882fb023a00054d5, aae130593f1342d48384124382555be8; no voters:
I20260807 06:17:21.702732 29978 raft_consensus.cc:2781] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:21.702988 29978 raft_consensus.cc:686] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 1 LEADER]: Becoming Leader. State: Replica: 2d07acf8edef4cfd882fb023a00054d5, State: Running, Role: LEADER
I20260807 06:17:21.703363 29978 consensus_queue.cc:237] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } }
I20260807 06:17:21.706897 29227 catalog_manager.cc:5495] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "2d07acf8edef4cfd882fb023a00054d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } health_report { overall_health: UNKNOWN } } }
W20260807 06:17:21.746922 29933 tablet.cc:2369] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:21.755086 29966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.751279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.26.252.67:37559)
0807 06:17:21.751434 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.751438 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.751453 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:21.751662 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.751670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.751730 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.751839 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:21.752101 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.752649 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.753555 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.753778 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.753886 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.754229 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:21.754678 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:21.754810 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.754885 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.754942 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:21.760979 29426 raft_consensus.cc:1261] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Refusing update from remote peer 2d07acf8edef4cfd882fb023a00054d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:21.760979 29658 raft_consensus.cc:1261] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Refusing update from remote peer 2d07acf8edef4cfd882fb023a00054d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:21.761711 29983 consensus_queue.cc:1035] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:21.761879 29978 consensus_queue.cc:1035] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:17:21.765051 29735 tablet.cc:2369] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:21.770453 29994 mvcc.cc:205] Tried to move back new op lower bound from 7315797777445744640 to 7315797777220276224. Current Snapshot: MvccSnapshot[applied={T|T < 7315797777445744640}]
I20260807 06:17:21.771876 29993 mvcc.cc:205] Tried to move back new op lower bound from 7315797777445744640 to 7315797777220276224. Current Snapshot: MvccSnapshot[applied={T|T < 7315797777445744640}]
I20260807 06:17:21.782100 29225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:21.782444 29225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:21.785205 29225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Sending DeleteTablet for 3 replicas of tablet 47f8b6d1e1a74364af32e2b8b5675dbc
I20260807 06:17:21.786082 29635 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:21 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51770
I20260807 06:17:21.786152 29421 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:21 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:43132
I20260807 06:17:21.786798 30005 tablet_replica.cc:330] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: stopping tablet replica
I20260807 06:17:21.786943 29828 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f8b6d1e1a74364af32e2b8b5675dbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:21 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51224
I20260807 06:17:21.787454 30008 tablet_replica.cc:330] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: stopping tablet replica
I20260807 06:17:21.787442 29225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:17:21.787810 30008 raft_consensus.cc:2229] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 1 LEADER]: Raft consensus shutting down.
W20260807 06:17:21.787854 29225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:21.788209 30008 raft_consensus.cc:2258] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:21.787272 30005 raft_consensus.cc:2229] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:21.788791 30005 raft_consensus.cc:2258] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:21.790493 30008 ts_tablet_manager.cc:1905] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:21.791424 30005 ts_tablet_manager.cc:1905] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:21.792896 29421 tablet_service.cc:1467] Processing CreateTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (DEFAULT_TABLE table=test-table [id=de94705c4a774d5981d948e248ea4a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.793161 29421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.793210 29635 tablet_service.cc:1467] Processing CreateTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (DEFAULT_TABLE table=test-table [id=de94705c4a774d5981d948e248ea4a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.794253 30003 tablet_replica.cc:330] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: stopping tablet replica
I20260807 06:17:21.794384 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.794602 30003 raft_consensus.cc:2229] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:21.794911 30003 raft_consensus.cc:2258] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:21.795485 29970 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Bootstrap starting.
I20260807 06:17:21.795770 29828 tablet_service.cc:1467] Processing CreateTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (DEFAULT_TABLE table=test-table [id=de94705c4a774d5981d948e248ea4a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:21.796471 29828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.796566 29970 tablet_bootstrap.cc:654] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.797215 29972 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Bootstrap starting.
I20260807 06:17:21.798166 29972 tablet_bootstrap.cc:654] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.798338 30005 ts_tablet_manager.cc:1918] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:21.798470 30005 log.cc:1196] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/47f8b6d1e1a74364af32e2b8b5675dbc
I20260807 06:17:21.798905 29969 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Bootstrap starting.
I20260807 06:17:21.799144 30005 ts_tablet_manager.cc:1939] T 47f8b6d1e1a74364af32e2b8b5675dbc P aae130593f1342d48384124382555be8: Deleting consensus metadata
I20260807 06:17:21.799908 29969 tablet_bootstrap.cc:654] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.800426 30008 ts_tablet_manager.cc:1918] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:21.800524 30008 log.cc:1196] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/47f8b6d1e1a74364af32e2b8b5675dbc
I20260807 06:17:21.800863 30008 ts_tablet_manager.cc:1939] T 47f8b6d1e1a74364af32e2b8b5675dbc P 2d07acf8edef4cfd882fb023a00054d5: Deleting consensus metadata
I20260807 06:17:21.801566 30003 ts_tablet_manager.cc:1905] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:21.802008 29205 catalog_manager.cc:4841] TS 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67:37559): tablet 47f8b6d1e1a74364af32e2b8b5675dbc (table test-table [id=ec70ad9d0cfc43babb520d28455466b5]) successfully deleted
I20260807 06:17:21.802591 29970 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: No bootstrap required, opened a new log
I20260807 06:17:21.802716 29970 ts_tablet_manager.cc:1397] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 06:17:21.803488 29970 raft_consensus.cc:348] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.803619 29970 raft_consensus.cc:374] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.803658 29970 raft_consensus.cc:729] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae130593f1342d48384124382555be8, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.803774 29970 consensus_queue.cc:260] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.804037 29970 ts_tablet_manager.cc:1428] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:21.804454 30003 ts_tablet_manager.cc:1918] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:21.804560 30003 log.cc:1196] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/47f8b6d1e1a74364af32e2b8b5675dbc
I20260807 06:17:21.804728 29210 catalog_manager.cc:4841] TS aae130593f1342d48384124382555be8 (127.26.252.65:37525): tablet 47f8b6d1e1a74364af32e2b8b5675dbc (table test-table [id=ec70ad9d0cfc43babb520d28455466b5]) successfully deleted
I20260807 06:17:21.804904 30003 ts_tablet_manager.cc:1939] T 47f8b6d1e1a74364af32e2b8b5675dbc P ebc53755fa49405191dd469a10396d81: Deleting consensus metadata
I20260807 06:17:21.805670 29972 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: No bootstrap required, opened a new log
I20260807 06:17:21.805774 29972 ts_tablet_manager.cc:1397] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260807 06:17:21.806221 29972 raft_consensus.cc:348] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.806327 29972 raft_consensus.cc:374] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.806358 29972 raft_consensus.cc:729] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc53755fa49405191dd469a10396d81, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.806516 29972 consensus_queue.cc:260] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.806783 29972 ts_tablet_manager.cc:1428] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:17:21.806993 29205 catalog_manager.cc:4841] TS ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255): tablet 47f8b6d1e1a74364af32e2b8b5675dbc (table test-table [id=ec70ad9d0cfc43babb520d28455466b5]) successfully deleted
I20260807 06:17:21.807999 29969 tablet_bootstrap.cc:492] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: No bootstrap required, opened a new log
I20260807 06:17:21.808102 29969 ts_tablet_manager.cc:1397] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 06:17:21.808491 29969 raft_consensus.cc:348] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.808609 29969 raft_consensus.cc:374] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.808650 29969 raft_consensus.cc:729] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d07acf8edef4cfd882fb023a00054d5, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.808789 29969 consensus_queue.cc:260] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.809090 29969 ts_tablet_manager.cc:1428] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:21.814707 29998 raft_consensus.cc:482] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:21.814807 29998 raft_consensus.cc:504] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.815220 29998 leader_election.cc:288] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae130593f1342d48384124382555be8 (127.26.252.65:37525), ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255)
I20260807 06:17:21.815557 29426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36b4942e9b0b4a8bb7f2e5f29abdb175" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae130593f1342d48384124382555be8" is_pre_election: true
I20260807 06:17:21.815588 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36b4942e9b0b4a8bb7f2e5f29abdb175" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81" is_pre_election: true
I20260807 06:17:21.815673 29426 raft_consensus.cc:2454] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 0.
I20260807 06:17:21.815722 29658 raft_consensus.cc:2454] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 0.
I20260807 06:17:21.815980 29773 leader_election.cc:302] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2d07acf8edef4cfd882fb023a00054d5, aae130593f1342d48384124382555be8, ebc53755fa49405191dd469a10396d81; no voters:
I20260807 06:17:21.816174 29998 raft_consensus.cc:2781] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:21.816244 29998 raft_consensus.cc:482] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:21.816283 29998 raft_consensus.cc:3037] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.817441 29998 raft_consensus.cc:504] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.817792 29998 leader_election.cc:288] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 election: Requested vote from peers aae130593f1342d48384124382555be8 (127.26.252.65:37525), ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255)
I20260807 06:17:21.818126 29426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36b4942e9b0b4a8bb7f2e5f29abdb175" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae130593f1342d48384124382555be8"
I20260807 06:17:21.818241 29426 raft_consensus.cc:3037] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.818559 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36b4942e9b0b4a8bb7f2e5f29abdb175" candidate_uuid: "2d07acf8edef4cfd882fb023a00054d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81"
I20260807 06:17:21.818684 29658 raft_consensus.cc:3037] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:21.819396 29426 raft_consensus.cc:2454] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 1.
I20260807 06:17:21.819675 29658 raft_consensus.cc:2454] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d07acf8edef4cfd882fb023a00054d5 in term 1.
I20260807 06:17:21.820019 29770 leader_election.cc:302] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d07acf8edef4cfd882fb023a00054d5, ebc53755fa49405191dd469a10396d81; no voters:
I20260807 06:17:21.820200 29998 raft_consensus.cc:2781] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:21.820279 29998 raft_consensus.cc:686] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 LEADER]: Becoming Leader. State: Replica: 2d07acf8edef4cfd882fb023a00054d5, State: Running, Role: LEADER
I20260807 06:17:21.820397 29998 consensus_queue.cc:237] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.821885 29227 catalog_manager.cc:5495] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "2d07acf8edef4cfd882fb023a00054d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } health_report { overall_health: HEALTHY } } }
Aug 07 06:17:21 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083440, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:21.857746 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.848241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44909 (local address 127.0.0.1:35098)
0807 06:17:21.848576 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.848592 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.848731 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.849004 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.849007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.849523 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:21.849653 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.849661 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.850484 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.850487 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.851402 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.851413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.851887 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.851890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.851982 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.852583 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:21.852599 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:21.854225 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:21.856041 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.856051 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.856058 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.856302 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.856585 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:21.856588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:21.856590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:21.856675 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:21.857048 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:21.857056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:21.857177 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.857293 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.857450 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":107,"threads_started":1}
I20260807 06:17:21.857764 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.848367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.26.252.126:44909)
0807 06:17:21.848493 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.848498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.848710 (+ 212us) server_negotiation.cc:407] Connection header received
0807 06:17:21.848829 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.848831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.848880 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.848957 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:21.849787 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.850335 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.851545 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.851769 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.851859 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.854368 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:21.854373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:21.854374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:21.854395 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:21.855914 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.856404 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.856409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.856411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.856489 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:21.856761 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:21.856767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:21.856769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:21.856942 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:21.857048 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.857338 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.857507 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":52}
I20260807 06:17:21.862097 29227 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:35098:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:17:21.862857 29227 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:21.867913 29421 tablet_service.cc:1467] Processing CreateTablet for tablet d9eb8e0c07da439481766671c1b98194 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=646be19faa2f41f594c329b073b70358]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:21.868009 29635 tablet_service.cc:1467] Processing CreateTablet for tablet d9eb8e0c07da439481766671c1b98194 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=646be19faa2f41f594c329b073b70358]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:21.868342 29421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9eb8e0c07da439481766671c1b98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.868432 29635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9eb8e0c07da439481766671c1b98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.870851 29828 tablet_service.cc:1467] Processing CreateTablet for tablet d9eb8e0c07da439481766671c1b98194 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=646be19faa2f41f594c329b073b70358]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:21.871239 29828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9eb8e0c07da439481766671c1b98194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:21.871407 29972 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: Bootstrap starting.
I20260807 06:17:21.872288 29972 tablet_bootstrap.cc:654] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.873569 29972 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: No bootstrap required, opened a new log
I20260807 06:17:21.873675 29972 ts_tablet_manager.cc:1397] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:21.873968 29969 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: Bootstrap starting.
I20260807 06:17:21.874195 29972 raft_consensus.cc:348] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.874308 29972 raft_consensus.cc:374] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.874342 29972 raft_consensus.cc:729] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc53755fa49405191dd469a10396d81, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.874498 29972 consensus_queue.cc:260] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.874786 29972 ts_tablet_manager.cc:1428] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:21.875139 29969 tablet_bootstrap.cc:654] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.875690 29970 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: Bootstrap starting.
I20260807 06:17:21.875661 29979 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:21.875821 29979 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:21.876701 29970 tablet_bootstrap.cc:654] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:21.876829 29969 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: No bootstrap required, opened a new log
I20260807 06:17:21.876921 29969 ts_tablet_manager.cc:1397] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:21.877384 29969 raft_consensus.cc:348] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.877494 29969 raft_consensus.cc:374] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.877527 29969 raft_consensus.cc:729] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d07acf8edef4cfd882fb023a00054d5, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.877655 29969 consensus_queue.cc:260] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.877972 29969 ts_tablet_manager.cc:1428] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:21.878011 29998 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:21.878141 29998 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:21.879997 29970 tablet_bootstrap.cc:492] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: No bootstrap required, opened a new log
I20260807 06:17:21.880075 29970 ts_tablet_manager.cc:1397] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:17:21.880487 29970 raft_consensus.cc:348] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.880581 29970 raft_consensus.cc:374] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:21.880604 29970 raft_consensus.cc:729] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae130593f1342d48384124382555be8, State: Initialized, Role: FOLLOWER
I20260807 06:17:21.880757 29970 consensus_queue.cc:260] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.881054 29970 ts_tablet_manager.cc:1428] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:21.880995 29980 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:21.881134 29980 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:21.993582 29980 raft_consensus.cc:482] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:21.993746 29980 raft_consensus.cc:504] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:21.995093 29980 leader_election.cc:288] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255), 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67:37559)
I20260807 06:17:21.999553 29959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.995617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:58495 (local address 127.26.252.66:37255)
0807 06:17:21.995763 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.995767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.995899 (+ 132us) server_negotiation.cc:407] Connection header received
0807 06:17:21.996106 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.996110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.996169 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.996230 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.996628 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.997315 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.998403 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.998829 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.999014 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.999096 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.999364 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.999447 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:17:21.999577 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.995424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:37255 (local address 127.26.252.65:58495)
0807 06:17:21.995777 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.995803 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.995938 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.996359 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.996362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.996379 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.996517 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.996524 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.997436 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.997440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.998261 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.998272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.999133 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.999136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.999227 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.999246 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 06:17:21.999333 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 06:17:21.999410 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":153,"threads_started":1}
I20260807 06:17:22.000061 29966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.996056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:45977 (local address 127.26.252.67:37559)
0807 06:17:21.996196 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:21.996200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:21.996519 (+ 319us) server_negotiation.cc:407] Connection header received
0807 06:17:21.996752 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:21.996756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:21.996811 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:21.996898 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:21.997286 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.997888 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.998975 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.999436 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.999561 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.999613 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:21.999849 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 06:17:21.999927 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:22.000073 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9eb8e0c07da439481766671c1b98194" candidate_uuid: "aae130593f1342d48384124382555be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81" is_pre_election: true
I20260807 06:17:22.000262 29658 raft_consensus.cc:2454] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae130593f1342d48384124382555be8 in term 0.
I20260807 06:17:22.000485 30028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:21.995926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:37559 (local address 127.26.252.65:45977)
0807 06:17:21.996399 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:21.996413 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:21.996616 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:21.996924 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:21.996926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:21.996944 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:21.997116 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.997124 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.997999 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.998004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.998843 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:21.998852 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:21.999564 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:21.999568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:21.999680 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:21.999726 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 06:17:22.000239 (+ 513us) client_negotiation.cc:240] Negotiation successful
0807 06:17:22.000309 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":12,"thread_start_us":110,"threads_started":1}
I20260807 06:17:22.000674 29351 leader_election.cc:302] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae130593f1342d48384124382555be8, ebc53755fa49405191dd469a10396d81; no voters:
I20260807 06:17:22.000993 29980 raft_consensus.cc:2781] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:22.001109 29980 raft_consensus.cc:482] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:22.001185 29980 raft_consensus.cc:3037] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:22.001432 29862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9eb8e0c07da439481766671c1b98194" candidate_uuid: "aae130593f1342d48384124382555be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d07acf8edef4cfd882fb023a00054d5" is_pre_election: true
I20260807 06:17:22.001690 29862 raft_consensus.cc:2454] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aae130593f1342d48384124382555be8 in term 0.
I20260807 06:17:22.002612 29980 raft_consensus.cc:504] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:22.002985 29980 leader_election.cc:288] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [CANDIDATE]: Term 1 election: Requested vote from peers ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255), 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67:37559)
I20260807 06:17:22.003348 29658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9eb8e0c07da439481766671c1b98194" candidate_uuid: "aae130593f1342d48384124382555be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc53755fa49405191dd469a10396d81"
I20260807 06:17:22.003384 29862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9eb8e0c07da439481766671c1b98194" candidate_uuid: "aae130593f1342d48384124382555be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d07acf8edef4cfd882fb023a00054d5"
I20260807 06:17:22.003486 29658 raft_consensus.cc:3037] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:22.003515 29862 raft_consensus.cc:3037] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:22.004387 29658 raft_consensus.cc:2454] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae130593f1342d48384124382555be8 in term 1.
I20260807 06:17:22.004631 29862 raft_consensus.cc:2454] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aae130593f1342d48384124382555be8 in term 1.
I20260807 06:17:22.004714 29351 leader_election.cc:302] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae130593f1342d48384124382555be8, ebc53755fa49405191dd469a10396d81; no voters:
I20260807 06:17:22.004900 29980 raft_consensus.cc:2781] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:22.005168 29980 raft_consensus.cc:686] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [term 1 LEADER]: Becoming Leader. State: Replica: aae130593f1342d48384124382555be8, State: Running, Role: LEADER
I20260807 06:17:22.005427 29980 consensus_queue.cc:237] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } }
I20260807 06:17:22.006871 30029 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: TxnStatusTablet state changed. Reason: New leader aae130593f1342d48384124382555be8. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.007014 30029 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:22.007369 30033 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:17:22.007598 30033 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:17:22.008399 29225 catalog_manager.cc:5495] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aae130593f1342d48384124382555be8 (127.26.252.65). New cstate: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } health_report { overall_health: UNKNOWN } } }
W20260807 06:17:22.036952 29516 tablet.cc:2369] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:22.037542 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.032560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:37525 (local address 127.0.0.1:43138)
0807 06:17:22.032819 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:22.032836 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:22.032955 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:22.033354 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:22.033357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:22.033366 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:22.033483 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.033490 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.034585 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.034588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.035525 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.035537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.036153 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.036157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.036250 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.036300 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.037203 (+ 903us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.037219 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 06:17:22.037286 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 06:17:22.037378 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260807 06:17:22.038121 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.032683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43138 (local address 127.26.252.65:37525)
0807 06:17:22.032824 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:22.032829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:22.032901 (+ 72us) server_negotiation.cc:407] Connection header received
0807 06:17:22.033151 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:22.033154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:22.033220 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:22.033316 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:22.033630 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.034463 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.035649 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.036025 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.036123 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.036475 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.036988 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.037102 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:22.037926 (+ 824us) server_negotiation.cc:299] Negotiation successful
0807 06:17:22.037985 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:17:22.041276 29658 raft_consensus.cc:1261] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Refusing update from remote peer aae130593f1342d48384124382555be8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:22.041415 29862 raft_consensus.cc:1261] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Refusing update from remote peer aae130593f1342d48384124382555be8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:22.041762 29980 consensus_queue.cc:1035] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:22.042135 29980 consensus_queue.cc:1035] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:22.043205 29979 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: TxnStatusTablet state changed. Reason: New leader aae130593f1342d48384124382555be8. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.043313 29979 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:22.043689 29998 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: TxnStatusTablet state changed. Reason: New leader aae130593f1342d48384124382555be8. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.043807 29998 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:22.046121 29980 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.046228 29980 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:22.048110 29979 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.048239 29979 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P ebc53755fa49405191dd469a10396d81: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:22.052312 29990 mvcc.cc:205] Tried to move back new op lower bound from 7315797778595692544 to 7315797778456907776. Current Snapshot: MvccSnapshot[applied={T|T < 7315797778595692544}]
I20260807 06:17:22.053236 29998 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.053344 29998 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P 2d07acf8edef4cfd882fb023a00054d5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:22.054913 30047 tablet_replica.cc:439] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aae130593f1342d48384124382555be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 } } peers { permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 } } peers { permanent_uuid: "2d07acf8edef4cfd882fb023a00054d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 37559 } } }
I20260807 06:17:22.055086 30047 tablet_replica.cc:442] T d9eb8e0c07da439481766671c1b98194 P aae130593f1342d48384124382555be8: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:22.063345 30052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.059900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:37525 (local address 127.26.252.67:60357)
0807 06:17:22.060200 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:22.060216 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:22.060324 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:22.060547 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:22.060550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:22.060558 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:22.060683 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.060689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.061389 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.061394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.062053 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.062063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.062546 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.062551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.062646 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.062695 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.062989 (+ 294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.062998 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:17:22.063124 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 06:17:22.063218 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":73,"threads_started":1}
I20260807 06:17:22.063336 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.060033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:60357 (local address 127.26.252.65:37525)
0807 06:17:22.060149 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:22.060154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:22.060287 (+ 133us) server_negotiation.cc:407] Connection header received
0807 06:17:22.060410 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:22.060412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:22.060452 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:22.060515 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:22.060791 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.061278 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.062175 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.062393 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.062553 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.062837 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.062904 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.062982 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:22.063152 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:17:22.063208 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:17:22.070253 29658 raft_consensus.cc:1261] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Refusing update from remote peer 2d07acf8edef4cfd882fb023a00054d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:22.070379 29426 raft_consensus.cc:1261] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Refusing update from remote peer 2d07acf8edef4cfd882fb023a00054d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:22.070722 29998 consensus_queue.cc:1035] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc53755fa49405191dd469a10396d81" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:22.070881 29978 consensus_queue.cc:1035] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae130593f1342d48384124382555be8" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 37525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:22.098565 29966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.093865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:43723 (local address 127.26.252.67:37559)
0807 06:17:22.093987 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:22.093992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:22.094750 (+ 758us) server_negotiation.cc:407] Connection header received
0807 06:17:22.094938 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:22.094941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:22.094987 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:22.095033 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:22.095424 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.095947 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.097211 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.097458 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.097567 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.097946 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.098037 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.098142 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:22.098355 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 06:17:22.098431 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:17:22.098613 30056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.093518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:37559 (local address 127.26.252.65:43723)
0807 06:17:22.094655 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:22.094679 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:22.094825 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:22.095161 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:22.095164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:22.095172 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:22.095321 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.095327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.096066 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.096070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.097022 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:22.097034 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.097599 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.097603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:22.097713 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.097769 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:22.098240 (+ 471us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:22.098245 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:17:22.098319 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:17:22.098428 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"thread_start_us":94,"threads_started":1}
I20260807 06:17:22.117344 29227 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:22.117512 29227 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:22.119571 29227 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e72e867fd6a246a2855cfdbd18155fea: Sending DeleteTablet for 3 replicas of tablet 36b4942e9b0b4a8bb7f2e5f29abdb175
I20260807 06:17:22.120096 29421 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:22 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:43132
I20260807 06:17:22.120146 29635 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:22 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51770
I20260807 06:17:22.120339 30003 tablet_replica.cc:330] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: stopping tablet replica
I20260807 06:17:22.120364 30005 tablet_replica.cc:330] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: stopping tablet replica
I20260807 06:17:22.120471 30005 raft_consensus.cc:2229] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:22.120471 30003 raft_consensus.cc:2229] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:22.120582 30003 raft_consensus.cc:2258] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:22.120582 30005 raft_consensus.cc:2258] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:22.121287 30003 ts_tablet_manager.cc:1905] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:22.121367 30005 ts_tablet_manager.cc:1905] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:22.123732 30003 ts_tablet_manager.cc:1918] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:22.123834 30003 log.cc:1196] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/36b4942e9b0b4a8bb7f2e5f29abdb175
I20260807 06:17:22.124074 30003 ts_tablet_manager.cc:1939] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P ebc53755fa49405191dd469a10396d81: Deleting consensus metadata
I20260807 06:17:22.124274 29828 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:22 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51224
I20260807 06:17:22.124495 30008 tablet_replica.cc:330] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: stopping tablet replica
I20260807 06:17:22.124619 30008 raft_consensus.cc:2229] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:22.124816 30008 raft_consensus.cc:2258] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:22.124949 30005 ts_tablet_manager.cc:1918] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:22.124959 29205 catalog_manager.cc:4841] TS ebc53755fa49405191dd469a10396d81 (127.26.252.66:37255): tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (table test-table [id=de94705c4a774d5981d948e248ea4a06]) successfully deleted
I20260807 06:17:22.125208 30005 log.cc:1196] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/36b4942e9b0b4a8bb7f2e5f29abdb175
I20260807 06:17:22.125590 30005 ts_tablet_manager.cc:1939] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P aae130593f1342d48384124382555be8: Deleting consensus metadata
I20260807 06:17:22.125603 30008 ts_tablet_manager.cc:1905] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:22.126276 29210 catalog_manager.cc:4841] TS aae130593f1342d48384124382555be8 (127.26.252.65:37525): tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (table test-table [id=de94705c4a774d5981d948e248ea4a06]) successfully deleted
I20260807 06:17:22.128419 30008 ts_tablet_manager.cc:1918] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:22.128516 30008 log.cc:1196] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/36b4942e9b0b4a8bb7f2e5f29abdb175
I20260807 06:17:22.128751 30008 ts_tablet_manager.cc:1939] T 36b4942e9b0b4a8bb7f2e5f29abdb175 P 2d07acf8edef4cfd882fb023a00054d5: Deleting consensus metadata
I20260807 06:17:22.129479 29205 catalog_manager.cc:4841] TS 2d07acf8edef4cfd882fb023a00054d5 (127.26.252.67:37559): tablet 36b4942e9b0b4a8bb7f2e5f29abdb175 (table test-table [id=de94705c4a774d5981d948e248ea4a06]) successfully deleted
Aug 07 06:17:22 dist-test-slave-68xk krb5kdc[29163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083441, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:22.139154 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.127815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43142 (local address 127.26.252.65:37525)
0807 06:17:22.127929 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:22.127934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:22.128238 (+ 304us) server_negotiation.cc:407] Connection header received
0807 06:17:22.128466 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:22.128469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:22.128518 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:22.128570 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:22.129593 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.130393 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.131230 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.131563 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.131682 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.135267 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:22.135277 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:22.135287 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:22.135311 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:22.137116 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:22.137594 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:22.137599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:22.137600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:22.137697 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:22.137976 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:22.137978 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:22.137979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:22.138263 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:22.138492 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:22.138831 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 06:17:22.138945 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 06:17:22.139674 29507 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43142
I20260807 06:17:22.150512 29295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:22.141593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35102 (local address 127.26.252.126:44909)
0807 06:17:22.141786 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:22.141790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:22.142118 (+ 328us) server_negotiation.cc:407] Connection header received
0807 06:17:22.142231 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:22.142233 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:22.142289 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:22.142367 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:22.143078 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.143891 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.144783 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:22.145133 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:22.145253 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:22.146832 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:22.146836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:22.146839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:22.146872 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:22.148564 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:22.149137 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:22.149141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:22.149143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:22.149237 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:22.149562 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:22.149565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:22.149567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:22.149793 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:22.149933 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:22.150135 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 06:17:22.150261 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 06:17:22.151015 29227 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35102
I20260807 06:17:22.152328 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 29334
I20260807 06:17:22.169420 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 29526
I20260807 06:17:22.176909 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 29745
I20260807 06:17:22.190783 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 29186
2026-08-07T06:17:22Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2995 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:22 dist-test-slave-68xk krb5kdc[30067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:22 dist-test-slave-68xk krb5kdc[30067](info): set up 2 sockets
Aug 07 06:17:22 dist-test-slave-68xk krb5kdc[30067](info): commencing operation
krb5kdc: starting...
W20260807 06:17:23.405516 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:23 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:23.537001 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40157
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:40157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:23.650588 30080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:23.650887 30080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:23.650959 30080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:23.654891 30080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:23.654981 30080 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:17:23.655014 30080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:23.655051 30080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:23.655094 30080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:23.655136 30080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:23.660295 30080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:40157
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:23.661320 30080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:23.662338 30080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:23.670709 30095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:23.670755 30090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:23.670745 30093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:23.670794 30080 server_base.cc:1034] running on GCE node
I20260807 06:17:23.671566 30080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:23.672641 30080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:23.673830 30080 hybrid_clock.cc:648] HybridClock initialized: now 1786083443673810 us; error 30 us; skew 500 ppm
Aug 07 06:17:23 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:23.676664 30080 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:23.677562 30080 webserver.cc:460] Webserver started at http://127.26.252.126:39679/ using document root <none> and password file <none>
I20260807 06:17:23.678081 30080 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:23.678139 30080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:23.678313 30080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:23.680380 30080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "8786942346e2493b950f588ea8049d6e"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "d188a3a7f0ada93f50072971bb8e0fc4"
server_key_iv: "94d8b379575f37ce069546acca155c11"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.680881 30080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "8786942346e2493b950f588ea8049d6e"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "d188a3a7f0ada93f50072971bb8e0fc4"
server_key_iv: "94d8b379575f37ce069546acca155c11"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.684603 30080 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 06:17:23.687100 30104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:23.688380 30080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:17:23.688498 30080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "8786942346e2493b950f588ea8049d6e"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "d188a3a7f0ada93f50072971bb8e0fc4"
server_key_iv: "94d8b379575f37ce069546acca155c11"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.688587 30080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:23.703302 30080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:23.706583 30080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:23.706740 30080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:23.714727 30080 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:40157
I20260807 06:17:23.714759 30201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:40157 every 8 connection(s)
I20260807 06:17:23.715667 30080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:23.718482 30202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:23.723613 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 30080
I20260807 06:17:23.723743 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:23.724014 27633 external_mini_cluster.cc:1428] Setting key fba2898dda8783157a2d035b91a425ee
I20260807 06:17:23.724169 30202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Bootstrap starting.
I20260807 06:17:23.726712 30202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:23.727560 30202 log.cc:824] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:23.729660 30202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: No bootstrap required, opened a new log
Aug 07 06:17:23 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:23.734086 30202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } }
I20260807 06:17:23.734349 30202 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:23.734447 30202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8786942346e2493b950f588ea8049d6e, State: Initialized, Role: FOLLOWER
I20260807 06:17:23.735004 30202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } }
I20260807 06:17:23.735167 30202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:23.735270 30202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:23.735416 30202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:23.736284 30202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } }
I20260807 06:17:23.736632 30202 leader_election.cc:302] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8786942346e2493b950f588ea8049d6e; no voters:
I20260807 06:17:23.736961 30202 leader_election.cc:288] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:23.737095 30210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:23.737316 30210 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [term 1 LEADER]: Becoming Leader. State: Replica: 8786942346e2493b950f588ea8049d6e, State: Running, Role: LEADER
I20260807 06:17:23.737663 30210 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } }
I20260807 06:17:23.738286 30202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:23.739485 30212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8786942346e2493b950f588ea8049d6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } } }
I20260807 06:17:23.739621 30212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:23.739851 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:23.725492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39048 (local address 127.26.252.126:40157)
0807 06:17:23.725963 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:23.725979 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:23.726017 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:17:23.726707 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:23.726726 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:23.727098 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:23.727377 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:23.728328 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.729366 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.730579 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.731034 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.731188 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:23.734042 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:23.734048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:23.734064 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:23.734096 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:23.736230 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:23.736742 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:23.736748 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:23.736753 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:23.736913 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:23.737296 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:23.737299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:23.737300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:23.737838 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:23.738071 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:23.738394 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 06:17:23.738751 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":141,"threads_started":1}
I20260807 06:17:23.740070 30222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:23.739854 30211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8786942346e2493b950f588ea8049d6e. Latest consensus state: current_term: 1 leader_uuid: "8786942346e2493b950f588ea8049d6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8786942346e2493b950f588ea8049d6e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40157 } } }
I20260807 06:17:23.740954 30211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:23.743324 30222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:23.750859 30222 catalog_manager.cc:1347] Generated new cluster ID: 98859eab438340258d17b0e35b6f7322
I20260807 06:17:23.750941 30222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:23.764129 30222 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:23.765352 30222 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:23.780119 30222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Generated new TSK 0
I20260807 06:17:23.780964 30222 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:23.813593 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40157
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:23.928953 30238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:23.929211 30238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:23.929258 30238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:23.933182 30238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:23.933238 30238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:23.933277 30238 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:17:23.933291 30238 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:23.933322 30238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:23.938370 30238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:40157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:23.939492 30238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:23.940527 30238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:17:23.950150 30238 server_base.cc:1034] running on GCE node
W20260807 06:17:23.950083 30245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:23.950083 30246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:23.950106 30250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:23.950865 30238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:23.951424 30238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:23.952584 30238 hybrid_clock.cc:648] HybridClock initialized: now 1786083443952566 us; error 30 us; skew 500 ppm
Aug 07 06:17:23 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:23.955511 30238 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:23.956367 30238 webserver.cc:460] Webserver started at http://127.26.252.65:33711/ using document root <none> and password file <none>
I20260807 06:17:23.956910 30238 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:23.956970 30238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:23.957134 30238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:23.959183 30238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "13d303cf7b364a88a64b89a39cae92ec"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "658853f66c4c100ed73965e1f96d499c"
server_key_iv: "63daf46adc8e002551e6c25f2d3234b4"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.959761 30238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "13d303cf7b364a88a64b89a39cae92ec"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "658853f66c4c100ed73965e1f96d499c"
server_key_iv: "63daf46adc8e002551e6c25f2d3234b4"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.963446 30238 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:17:23.965858 30260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:23.967097 30238 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:17:23.967196 30238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "13d303cf7b364a88a64b89a39cae92ec"
format_stamp: "Formatted at 2026-08-07 06:17:23 on dist-test-slave-68xk"
server_key: "658853f66c4c100ed73965e1f96d499c"
server_key_iv: "63daf46adc8e002551e6c25f2d3234b4"
server_key_version: "encryptionkey@0"
I20260807 06:17:23.967280 30238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:23.983942 30238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:23.987115 30238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:23.987268 30238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:23.988616 30238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:23.988667 30238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:23.988732 30238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:23.988773 30238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:23 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:24.000566 30238 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:40037
I20260807 06:17:24.000794 30435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:40037 every 8 connection(s)
I20260807 06:17:24.001688 30238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:24.004074 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:23.989572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56393 (local address 127.26.252.126:40157)
0807 06:17:23.989703 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:23.989707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:23.990849 (+ 1142us) server_negotiation.cc:407] Connection header received
0807 06:17:23.992809 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:23.992814 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:23.992887 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:23.992985 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:23.994697 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.995237 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.996576 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.996891 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.997013 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.000092 (+ 3079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.000096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.000098 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.000134 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.001716 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.002338 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.002342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.002344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.002467 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.002912 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.002915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.002916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.003104 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.003277 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.003823 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.003947 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:17:24.004944 30273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:23.990148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.65:56393)
0807 06:17:23.990693 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:23.990738 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:23.992459 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:23.993292 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:23.993301 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:23.993822 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:23.994536 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:23.994553 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.995373 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.995376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:23.996444 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:23.996455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:23.997061 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:23.997065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:23.997243 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:23.997880 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:23.997896 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:23.999913 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.001876 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.001881 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.001896 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.002202 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.002594 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.002598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.002601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.002796 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.003343 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.003348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.003573 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.003726 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.003980 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":176,"threads_started":1}
I20260807 06:17:24.006170 30436 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40157
I20260807 06:17:24.006381 30436 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:24.006884 30436 heartbeater.cc:511] Master 127.26.252.126:40157 requested a full tablet report, sending...
I20260807 06:17:24.008533 30136 ts_manager.cc:194] Registered new tserver with Master: 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037)
I20260807 06:17:24.009935 30136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:56393
I20260807 06:17:24.010315 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 30238
I20260807 06:17:24.010479 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:24.010783 27633 external_mini_cluster.cc:1428] Setting key 4fa279dc46663a24fd134fcbd34763b6
I20260807 06:17:24.016587 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.008698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35523 (local address 127.26.252.126:40157)
0807 06:17:24.008837 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.008843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.009091 (+ 248us) server_negotiation.cc:407] Connection header received
0807 06:17:24.009165 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.009168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.009212 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.009306 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.009665 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.010363 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.011582 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.011893 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.011968 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.013249 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.013256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.013262 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.013294 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.014859 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.015369 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.015371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.015372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.015444 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.015769 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.015772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.015773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.015933 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.016011 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.016369 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.016476 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:17:24.016773 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.008748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.65:35523)
0807 06:17:24.009003 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.009015 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.009096 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.009309 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.009311 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.009473 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.009563 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.009568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.010668 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.010672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.011431 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.011441 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.012129 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.012132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.012230 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.012755 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.012775 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.013101 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.014972 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.014977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.014980 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.015262 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.015536 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.015541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.015545 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.015654 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.016034 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.016040 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.016156 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.016306 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.016479 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:24.041405 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40157
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:24.154748 30448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:24.155025 30448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:24.155102 30448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:24.159088 30448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:24.159165 30448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:24.159232 30448 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:17:24.159271 30448 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:24.159340 30448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:24.164482 30448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:40157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:24.165493 30448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:24.166555 30448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:24.176427 30457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:24.176417 30455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:24.176478 30448 server_base.cc:1034] running on GCE node
W20260807 06:17:24.176434 30461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:24.177060 30448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:24.177747 30448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:24.178920 30448 hybrid_clock.cc:648] HybridClock initialized: now 1786083444178906 us; error 25 us; skew 500 ppm
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:24.181854 30448 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:24.182838 30448 webserver.cc:460] Webserver started at http://127.26.252.66:44989/ using document root <none> and password file <none>
I20260807 06:17:24.183421 30448 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:24.183516 30448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:24.183753 30448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:24.185827 30448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "6dd7d348032a483d811bf151e8b0f041"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "6f7f66ec81276548704591bff96467f3"
server_key_iv: "9c0459cff6b51de0d0e3a4d2cee5a568"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.186523 30448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "6dd7d348032a483d811bf151e8b0f041"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "6f7f66ec81276548704591bff96467f3"
server_key_iv: "9c0459cff6b51de0d0e3a4d2cee5a568"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.190315 30448 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260807 06:17:24.192791 30470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:24.194213 30448 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:24.194363 30448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "6dd7d348032a483d811bf151e8b0f041"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "6f7f66ec81276548704591bff96467f3"
server_key_iv: "9c0459cff6b51de0d0e3a4d2cee5a568"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.194520 30448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:24.209421 30448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:24.212898 30448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:24.213126 30448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:24.214804 30448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:24.214882 30448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:24.214960 30448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:24.215013 30448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:24.227174 30448 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:38823
I20260807 06:17:24.227299 30652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:38823 every 8 connection(s)
I20260807 06:17:24.228533 30448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:24.230967 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.215508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:47939 (local address 127.26.252.126:40157)
0807 06:17:24.215685 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.215691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.217086 (+ 1395us) server_negotiation.cc:407] Connection header received
0807 06:17:24.218704 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.218707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.218771 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.218871 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.220265 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.220915 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.223014 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.223392 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.223514 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.226751 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.226755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.226758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.226790 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.228718 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.229300 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.229304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.229306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.229413 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.229819 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.229822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.229823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.230090 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.230168 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.230720 (+ 552us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.230845 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:17:24.231820 30483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.216376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.66:47939)
0807 06:17:24.216911 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.216973 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.218397 (+ 1424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.219060 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.219067 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.219549 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.220110 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.220124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.221052 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.221059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.222848 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.222865 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.223573 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.223578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.223808 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.224485 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.224511 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.226578 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.228841 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.228845 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.228857 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.229157 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.229547 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.229550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.229551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.229704 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.230176 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.230181 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.230459 (+ 278us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.230652 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.230921 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":113,"threads_started":1}
I20260807 06:17:24.233088 30653 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40157
I20260807 06:17:24.233253 30653 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:24.233719 30653 heartbeater.cc:511] Master 127.26.252.126:40157 requested a full tablet report, sending...
I20260807 06:17:24.234855 30133 ts_manager.cc:194] Registered new tserver with Master: 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823)
I20260807 06:17:24.235585 30133 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:47939
I20260807 06:17:24.237931 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 30448
I20260807 06:17:24.238070 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:24.238461 27633 external_mini_cluster.cc:1428] Setting key 45554cc6ab0d4f625a6fbb95d34e4dd9
I20260807 06:17:24.243496 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.235485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:60687 (local address 127.26.252.126:40157)
0807 06:17:24.235616 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.235620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.235795 (+ 175us) server_negotiation.cc:407] Connection header received
0807 06:17:24.235904 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.235907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.235955 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.236033 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.236485 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.236971 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.237794 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.238072 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.238189 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.239838 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.239846 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.239848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.239889 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.241529 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.242062 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.242068 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.242072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.242154 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.242587 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.242593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.242596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.242861 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.242925 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.243232 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.243354 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:17:24.243510 30661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.235419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.66:60687)
0807 06:17:24.235701 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.235717 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.235819 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.236064 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.236067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.236272 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.236370 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.236376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.237103 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.237106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.237671 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.237678 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.238222 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.238226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.238334 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.239262 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.239278 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.239682 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.241649 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.241655 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.241660 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.241951 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.242244 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.242250 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.242255 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.242381 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.242989 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.242991 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.243066 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.243174 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.243324 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":98,"threads_started":1}
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:24.269866 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40157
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:38281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:24.385586 30666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:24.385948 30666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:24.385998 30666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:24.389905 30666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:24.389956 30666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:24.389997 30666 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:17:24.390010 30666 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:24.390041 30666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:24.395332 30666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:38281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:40157
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:24.396385 30666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:24.397424 30666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:24.407439 30674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:24.407430 30683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:24.407439 30676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:24.407832 30666 server_base.cc:1034] running on GCE node
I20260807 06:17:24.408319 30666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:24.408999 30666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:24.410195 30666 hybrid_clock.cc:648] HybridClock initialized: now 1786083444410177 us; error 33 us; skew 500 ppm
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:24.418385 30666 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:24.419364 30666 webserver.cc:460] Webserver started at http://127.26.252.67:37767/ using document root <none> and password file <none>
I20260807 06:17:24.419986 30666 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:24.420082 30666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:24.420320 30666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:24.422493 30666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "0d653f7c041f433c80b372ce4d0d5127"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "8ca18d28c635a8816d3a5282982652e1"
server_key_iv: "132511416c2e335cd3f1d8e2579062a8"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.423071 30666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "0d653f7c041f433c80b372ce4d0d5127"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "8ca18d28c635a8816d3a5282982652e1"
server_key_iv: "132511416c2e335cd3f1d8e2579062a8"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.426855 30666 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:24.429257 30694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:24.430603 30666 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:24.430743 30666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "0d653f7c041f433c80b372ce4d0d5127"
format_stamp: "Formatted at 2026-08-07 06:17:24 on dist-test-slave-68xk"
server_key: "8ca18d28c635a8816d3a5282982652e1"
server_key_iv: "132511416c2e335cd3f1d8e2579062a8"
server_key_version: "encryptionkey@0"
I20260807 06:17:24.430855 30666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:24.454022 30666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:24.457281 30666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:24.457481 30666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:24.459182 30666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:24.459287 30666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:24.459357 30666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:24.459401 30666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:24.470304 30666 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:39543
I20260807 06:17:24.470381 30855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:39543 every 8 connection(s)
I20260807 06:17:24.471518 30666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:24.474253 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.459830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:37105 (local address 127.26.252.126:40157)
0807 06:17:24.459983 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.459990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.461307 (+ 1317us) server_negotiation.cc:407] Connection header received
0807 06:17:24.462425 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.462428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.462493 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.462601 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.464109 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.465035 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.466790 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.467138 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.467265 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.470432 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.470438 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.470441 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.470470 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.472298 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.472824 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.472827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.472828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.472907 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.473319 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.473321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.473323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.473491 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.473567 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.473999 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.474096 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:24.475116 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.460668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.67:37105)
0807 06:17:24.461131 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.461183 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.462191 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.462795 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.462804 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.463219 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.463930 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.463951 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.465220 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.465227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.466646 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.466656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.467299 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.467303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.467482 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.468044 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.468065 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.470213 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.472400 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.472406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.472418 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.472725 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.473002 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.473009 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.473017 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.473203 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.473579 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.473583 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.473801 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.473954 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.474193 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":125,"threads_started":1}
I20260807 06:17:24.476313 30856 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40157
I20260807 06:17:24.476476 30856 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:24.476955 30856 heartbeater.cc:511] Master 127.26.252.126:40157 requested a full tablet report, sending...
I20260807 06:17:24.477273 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 30666
I20260807 06:17:24.477401 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:24.477707 27633 external_mini_cluster.cc:1428] Setting key a68ba702ec1f82ab471078a8b20c78cb
I20260807 06:17:24.478569 30136 ts_manager.cc:194] Registered new tserver with Master: 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543)
I20260807 06:17:24.479306 30136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:37105
I20260807 06:17:24.479856 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:17:24.486665 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.478632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:46249 (local address 127.26.252.126:40157)
0807 06:17:24.478737 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.478741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.479197 (+ 456us) server_negotiation.cc:407] Connection header received
0807 06:17:24.479299 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.479302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.479350 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.479430 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.480184 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.480918 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.481812 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.482202 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.482334 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.483606 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.483609 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.483611 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.483632 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.485030 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.485497 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.485505 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.485506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.485576 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.485853 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.485857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.485859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.486021 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.486127 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.486380 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.486519 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:17:24.486680 30865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.478825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.26.252.67:46249)
0807 06:17:24.479102 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.479117 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.479221 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.479537 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.479542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.479872 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.480048 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.480059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.481066 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.481069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.481693 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.481703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.482350 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.482355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.482514 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.482998 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.483018 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.483454 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.485153 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.485158 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.485160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.485392 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.485666 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.485669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.485671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.485764 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.486117 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.486120 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.486219 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.486324 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.486508 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":105,"threads_started":1}
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:24.508857 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.499844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39054 (local address 127.26.252.126:40157)
0807 06:17:24.500001 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.500007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.500024 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:17:24.500203 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.500206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.500252 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.500348 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.501160 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.501734 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.502791 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.503029 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.503295 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.505929 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.505932 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.505934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.505958 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.507358 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.507824 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.507827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.507828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.507901 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.508136 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.508139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.508141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.508311 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.508411 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.508610 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.508735 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:24.512133 30133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:24.515499 30133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:24.530968 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.525410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47538 (local address 127.26.252.67:39543)
0807 06:17:24.525833 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.525847 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.525990 (+ 143us) server_negotiation.cc:407] Connection header received
0807 06:17:24.526128 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.526133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.526321 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.526515 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.526781 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.527628 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.529477 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.530174 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.530272 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.530485 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.530691 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.530804 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":107,"threads_started":1}
I20260807 06:17:24.530970 30889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.525194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:39543 (local address 127.0.0.1:47538)
0807 06:17:24.525884 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.525897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.526019 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.526507 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.526513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.526538 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.526651 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.526660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.527755 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.527759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.529339 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.529351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.530338 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.530342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.530477 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.530517 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.530644 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.530817 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"mutex_wait_us":141,"thread_start_us":123,"threads_started":1}
I20260807 06:17:24.530997 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.524722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:40037 (local address 127.0.0.1:36586)
0807 06:17:24.525574 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.525589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.525678 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.526856 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.526861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.526881 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.526959 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.526965 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.528370 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.528373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.529564 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.529577 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.530393 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.530397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.530558 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.530585 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.530670 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.530813 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":30,"thread_start_us":90,"threads_started":1}
I20260807 06:17:24.531322 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.525118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36586 (local address 127.26.252.65:40037)
0807 06:17:24.526250 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.526256 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.526277 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:17:24.526349 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.526353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.526547 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.526677 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.527097 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.528182 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.529691 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.530207 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.530362 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.530543 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.531075 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.531183 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1016,"thread_start_us":102,"threads_started":1}
I20260807 06:17:24.532526 30887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.524345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38823 (local address 127.0.0.1:51084)
0807 06:17:24.525128 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.525184 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.525334 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.526253 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.526260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.526287 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.526402 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.526460 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.527939 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.527943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.529339 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.529351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.532058 (+ 2707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.532062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.532176 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.532201 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.532283 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.532366 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":103,"thread_start_us":122,"threads_started":1}
I20260807 06:17:24.532970 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.524541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51084 (local address 127.26.252.66:38823)
0807 06:17:24.524976 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.524989 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.525500 (+ 511us) server_negotiation.cc:407] Connection header received
0807 06:17:24.525617 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.525627 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.525866 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.526038 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.526602 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.527817 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.530551 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.531662 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.531788 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.531976 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.532719 (+ 743us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.532822 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":118,"threads_started":1}
I20260807 06:17:24.534468 30764 tablet_service.cc:1467] Processing CreateTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (DEFAULT_TABLE table=test-table [id=ac831e2800634c959fccd62042ae3588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.534667 30329 tablet_service.cc:1467] Processing CreateTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (DEFAULT_TABLE table=test-table [id=ac831e2800634c959fccd62042ae3588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.535668 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.535802 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.535619 30551 tablet_service.cc:1467] Processing CreateTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (DEFAULT_TABLE table=test-table [id=ac831e2800634c959fccd62042ae3588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.536537 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.542919 30896 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Bootstrap starting.
I20260807 06:17:24.544548 30900 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Bootstrap starting.
I20260807 06:17:24.544720 30898 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Bootstrap starting.
I20260807 06:17:24.545718 30896 tablet_bootstrap.cc:654] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.546608 30896 log.cc:824] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:24.546824 30898 tablet_bootstrap.cc:654] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.546824 30900 tablet_bootstrap.cc:654] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.547719 30898 log.cc:824] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:24.547792 30900 log.cc:824] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:24.548799 30896 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: No bootstrap required, opened a new log
I20260807 06:17:24.549034 30896 ts_tablet_manager.cc:1397] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260807 06:17:24.549824 30900 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: No bootstrap required, opened a new log
I20260807 06:17:24.550097 30900 ts_tablet_manager.cc:1397] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:17:24.550261 30898 tablet_bootstrap.cc:492] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: No bootstrap required, opened a new log
I20260807 06:17:24.550511 30898 ts_tablet_manager.cc:1397] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:17:24.553201 30896 raft_consensus.cc:348] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.553459 30896 raft_consensus.cc:374] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.553541 30896 raft_consensus.cc:729] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d303cf7b364a88a64b89a39cae92ec, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.554039 30896 consensus_queue.cc:260] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.554142 30900 raft_consensus.cc:348] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.554513 30900 raft_consensus.cc:374] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.554332 30898 raft_consensus.cc:348] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.554656 30898 raft_consensus.cc:374] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.554723 30898 raft_consensus.cc:729] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.554764 30436 heartbeater.cc:503] Master 127.26.252.126:40157 was elected leader, sending a full tablet report...
I20260807 06:17:24.555173 30896 ts_tablet_manager.cc:1428] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 06:17:24.555136 30898 consensus_queue.cc:260] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.555824 30856 heartbeater.cc:503] Master 127.26.252.126:40157 was elected leader, sending a full tablet report...
I20260807 06:17:24.555843 30900 raft_consensus.cc:729] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.556129 30898 ts_tablet_manager.cc:1428] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:17:24.556300 30900 consensus_queue.cc:260] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.556879 30653 heartbeater.cc:503] Master 127.26.252.126:40157 was elected leader, sending a full tablet report...
I20260807 06:17:24.558302 30900 ts_tablet_manager.cc:1428] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:17:24.607787 30906 raft_consensus.cc:482] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:24.607999 30906 raft_consensus.cc:504] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.609248 30906 leader_election.cc:288] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823), 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037)
I20260807 06:17:24.612869 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.609584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58393 (local address 127.26.252.66:38823)
0807 06:17:24.609724 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.609730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.609748 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:17:24.609820 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.609824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.609874 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.609981 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.610251 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.610841 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.611927 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.612322 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.612443 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.612497 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.612677 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.612745 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:17:24.612869 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.609428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38823 (local address 127.26.252.67:58393)
0807 06:17:24.609550 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.609570 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.609663 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.609991 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.609994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.610011 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.610132 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.610138 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.610949 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.610955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.611796 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.611805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.612444 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.612447 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.612556 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.612576 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.612660 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.612734 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:17:24.613525 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd72f646ca3e4b9bbaa83e0eb8a44fb7" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041" is_pre_election: true
I20260807 06:17:24.613602 30910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.609585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:40037 (local address 127.26.252.67:46829)
0807 06:17:24.610028 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.610039 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.610159 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.610442 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.610445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.610460 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.610929 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.610936 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.611677 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.611680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.612420 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.612428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.613189 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.613193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.613291 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.613316 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.613414 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.613479 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":149,"threads_started":1}
I20260807 06:17:24.613636 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.609757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:46829 (local address 127.26.252.65:40037)
0807 06:17:24.609911 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.609916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.610125 (+ 209us) server_negotiation.cc:407] Connection header received
0807 06:17:24.610285 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.610287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.610329 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.610412 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.611058 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.611555 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.612547 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.613025 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.613166 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.613214 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.613437 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.613518 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:17:24.613857 30578 raft_consensus.cc:2454] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:24.614171 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd72f646ca3e4b9bbaa83e0eb8a44fb7" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec" is_pre_election: true
I20260807 06:17:24.614383 30697 leader_election.cc:302] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.614482 30347 raft_consensus.cc:2454] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:24.614724 30906 raft_consensus.cc:2781] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:24.614826 30906 raft_consensus.cc:482] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:24.614885 30906 raft_consensus.cc:3037] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.615954 30906 raft_consensus.cc:504] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.616338 30906 leader_election.cc:288] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Requested vote from peers 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823), 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037)
I20260807 06:17:24.616649 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd72f646ca3e4b9bbaa83e0eb8a44fb7" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041"
I20260807 06:17:24.616707 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd72f646ca3e4b9bbaa83e0eb8a44fb7" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec"
I20260807 06:17:24.616762 30578 raft_consensus.cc:3037] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.616849 30347 raft_consensus.cc:3037] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.617872 30578 raft_consensus.cc:2454] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:24.617888 30347 raft_consensus.cc:2454] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:24.618170 30697 leader_election.cc:302] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.618350 30906 raft_consensus.cc:2781] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:24.618620 30906 raft_consensus.cc:686] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Becoming Leader. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Running, Role: LEADER
I20260807 06:17:24.618981 30906 consensus_queue.cc:237] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } }
I20260807 06:17:24.622087 30132 catalog_manager.cc:5495] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "0d653f7c041f433c80b372ce4d0d5127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:17:24 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083443, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:24.660315 30919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.652139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40157 (local address 127.0.0.1:39060)
0807 06:17:24.652461 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.652475 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.652580 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.652817 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.652819 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.653203 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:24.653300 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.653306 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.654071 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.654073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.654686 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.654695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.655184 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.655186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.655248 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.655820 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:24.655832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:24.657208 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:24.658895 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.658903 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.658908 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.659130 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.659389 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:24.659391 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:24.659393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:24.659471 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:24.659828 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:24.659834 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:24.659933 (+ 99us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.660023 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.660132 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":137,"threads_started":1}
I20260807 06:17:24.660322 30208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.652199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.26.252.126:40157)
0807 06:17:24.652360 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.652365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.652558 (+ 193us) server_negotiation.cc:407] Connection header received
0807 06:17:24.652659 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.652662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.652705 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.652774 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:24.653439 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.653976 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.654836 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.655068 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.655162 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.657369 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:24.657372 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:24.657374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:24.657398 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:24.658799 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.659224 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.659227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.659228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.659307 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:24.659550 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:24.659553 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:24.659554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:24.659737 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:24.659819 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.660088 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.660190 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 06:17:24.664213 30132 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:39060:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:17:24.664935 30132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:24.670152 30764 tablet_service.cc:1467] Processing CreateTablet for tablet 5a28b35dbac64952b7c59501ee2cb2fa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3bb7ce9d83a54c26ac2e13521df2b33c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:24.670079 30329 tablet_service.cc:1467] Processing CreateTablet for tablet 5a28b35dbac64952b7c59501ee2cb2fa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3bb7ce9d83a54c26ac2e13521df2b33c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:24.670326 30551 tablet_service.cc:1467] Processing CreateTablet for tablet 5a28b35dbac64952b7c59501ee2cb2fa (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3bb7ce9d83a54c26ac2e13521df2b33c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:24.670956 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a28b35dbac64952b7c59501ee2cb2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.670956 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a28b35dbac64952b7c59501ee2cb2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.670984 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a28b35dbac64952b7c59501ee2cb2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.673518 30900 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: Bootstrap starting.
I20260807 06:17:24.674104 30896 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: Bootstrap starting.
I20260807 06:17:24.674618 30900 tablet_bootstrap.cc:654] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.674853 30898 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: Bootstrap starting.
I20260807 06:17:24.675220 30896 tablet_bootstrap.cc:654] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.675966 30900 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: No bootstrap required, opened a new log
I20260807 06:17:24.676065 30900 ts_tablet_manager.cc:1397] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:24.676072 30898 tablet_bootstrap.cc:654] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.676605 30900 raft_consensus.cc:348] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.676719 30900 raft_consensus.cc:374] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.676753 30900 raft_consensus.cc:729] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.676782 30896 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: No bootstrap required, opened a new log
I20260807 06:17:24.676857 30896 ts_tablet_manager.cc:1397] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:24.676894 30900 consensus_queue.cc:260] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.677315 30896 raft_consensus.cc:348] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.677343 30909 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.677455 30896 raft_consensus.cc:374] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.677489 30896 raft_consensus.cc:729] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d303cf7b364a88a64b89a39cae92ec, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.677515 30909 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.677332 30900 ts_tablet_manager.cc:1428] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.677687 30896 consensus_queue.cc:260] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.677983 30896 ts_tablet_manager.cc:1428] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.678009 30898 tablet_bootstrap.cc:492] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: No bootstrap required, opened a new log
I20260807 06:17:24.678102 30898 ts_tablet_manager.cc:1397] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:24.678674 30898 raft_consensus.cc:348] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.678829 30898 raft_consensus.cc:374] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.678874 30898 raft_consensus.cc:729] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.679018 30898 consensus_queue.cc:260] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.679335 30906 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.679487 30906 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.679492 30905 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.679644 30905 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.679349 30898 ts_tablet_manager.cc:1428] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.711500 30909 raft_consensus.cc:482] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:24.711648 30909 raft_consensus.cc:504] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.712841 30909 leader_election.cc:288] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543)
I20260807 06:17:24.716902 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.713332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:40011 (local address 127.26.252.67:39543)
0807 06:17:24.713467 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.713473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.713491 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:17:24.713552 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.713555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.713606 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.713689 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.714097 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.714845 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.715890 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.716330 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.716460 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.716514 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.716709 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.716797 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:24.716922 30483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.713107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:39543 (local address 127.26.252.66:40011)
0807 06:17:24.713220 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.713275 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.713377 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.713791 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.713794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.713813 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.713969 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.713981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.714955 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.714962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.715747 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.715757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.716460 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.716464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.716580 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.716606 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.716689 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.716768 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 06:17:24.717617 30793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a28b35dbac64952b7c59501ee2cb2fa" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d653f7c041f433c80b372ce4d0d5127" is_pre_election: true
I20260807 06:17:24.717880 30793 raft_consensus.cc:2454] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 0.
I20260807 06:17:24.718075 30923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.713107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:40037 (local address 127.26.252.66:39259)
0807 06:17:24.713860 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.713873 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.714002 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.714372 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.714378 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.714401 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:24.714576 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.714583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.715564 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.715567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.716757 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.716768 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.717641 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.717645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.717756 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.717778 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.717858 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.717935 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":356,"thread_start_us":127,"threads_started":1}
I20260807 06:17:24.718127 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.713452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:39259 (local address 127.26.252.65:40037)
0807 06:17:24.713622 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.713629 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.713991 (+ 362us) server_negotiation.cc:407] Connection header received
0807 06:17:24.714157 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.714160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.714203 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.714245 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:24.714718 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.715409 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.716910 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.717522 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.717621 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.717666 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.717899 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.718002 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:17:24.718351 30473 leader_election.cc:302] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.718690 30909 raft_consensus.cc:2781] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:24.718772 30909 raft_consensus.cc:482] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:24.718823 30909 raft_consensus.cc:3037] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.718851 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a28b35dbac64952b7c59501ee2cb2fa" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec" is_pre_election: true
I20260807 06:17:24.718981 30347 raft_consensus.cc:2454] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 0.
I20260807 06:17:24.719939 30909 raft_consensus.cc:504] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.720315 30909 leader_election.cc:288] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 election: Requested vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543)
I20260807 06:17:24.720651 30793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a28b35dbac64952b7c59501ee2cb2fa" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d653f7c041f433c80b372ce4d0d5127"
I20260807 06:17:24.720640 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a28b35dbac64952b7c59501ee2cb2fa" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec"
I20260807 06:17:24.720758 30793 raft_consensus.cc:3037] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.720769 30347 raft_consensus.cc:3037] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.721925 30793 raft_consensus.cc:2454] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 1.
I20260807 06:17:24.721925 30347 raft_consensus.cc:2454] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 1.
I20260807 06:17:24.722266 30474 leader_election.cc:302] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d303cf7b364a88a64b89a39cae92ec, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.722545 30909 raft_consensus.cc:2781] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 06:17:24.722581 30857 tablet.cc:2369] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:24.722796 30909 raft_consensus.cc:686] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [term 1 LEADER]: Becoming Leader. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Running, Role: LEADER
I20260807 06:17:24.723176 30909 consensus_queue.cc:237] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.725654 30925 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: TxnStatusTablet state changed. Reason: New leader 6dd7d348032a483d811bf151e8b0f041. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.725767 30925 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:24.726140 30928 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:17:24.726367 30928 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:17:24.726879 30136 catalog_manager.cc:5495] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } health_report { overall_health: UNKNOWN } } }
W20260807 06:17:24.729918 30654 tablet.cc:2369] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:24.747550 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.743340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51094 (local address 127.26.252.66:38823)
0807 06:17:24.743471 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.743474 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.743490 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:17:24.743756 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.743759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.743844 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.743946 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.744218 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.744711 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.745945 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.746166 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.746255 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.746637 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.747105 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.747200 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.747335 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.747410 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:17:24.747550 30919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.743170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38823 (local address 127.0.0.1:51094)
0807 06:17:24.743438 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.743454 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.743560 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.743982 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.743985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.743992 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:24.744108 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.744114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.744825 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.744829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.745809 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.745820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.746278 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.746282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.746404 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.746483 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.747210 (+ 727us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.747226 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.747301 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.747391 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260807 06:17:24.752743 30793 raft_consensus.cc:1261] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Refusing update from remote peer 6dd7d348032a483d811bf151e8b0f041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:24.752739 30347 raft_consensus.cc:1261] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Refusing update from remote peer 6dd7d348032a483d811bf151e8b0f041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 06:17:24.753186 30438 tablet.cc:2369] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:24.753423 30909 consensus_queue.cc:1035] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:24.753662 30925 consensus_queue.cc:1035] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:24.756891 30906 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: TxnStatusTablet state changed. Reason: New leader 6dd7d348032a483d811bf151e8b0f041. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.757012 30906 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.757861 30905 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: TxnStatusTablet state changed. Reason: New leader 6dd7d348032a483d811bf151e8b0f041. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.757970 30905 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.760116 30909 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.760300 30909 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:24.760773 30906 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.760891 30906 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 0d653f7c041f433c80b372ce4d0d5127: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.763864 30909 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.763975 30909 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 6dd7d348032a483d811bf151e8b0f041: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:24.766232 30905 tablet_replica.cc:439] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } } }
I20260807 06:17:24.766353 30905 tablet_replica.cc:442] T 5a28b35dbac64952b7c59501ee2cb2fa P 13d303cf7b364a88a64b89a39cae92ec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:24.773416 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.769215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47546 (local address 127.26.252.67:39543)
0807 06:17:24.769343 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.769348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.769382 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:17:24.769543 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.769546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.769611 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.769717 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.769994 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.770802 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.771749 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.772095 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.772204 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.772488 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.773001 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.773117 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.773215 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.773274 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:17:24.784610 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.781469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:54637 (local address 127.26.252.66:38823)
0807 06:17:24.781595 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.781600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.781615 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:24.781703 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.781706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.781768 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.781848 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.782088 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.782666 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.783546 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.783756 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.783862 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.784163 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.784231 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.784306 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.784423 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.784474 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:17:24.784610 30865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.781368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38823 (local address 127.26.252.67:54637)
0807 06:17:24.781507 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.781526 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.781613 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.781860 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.781863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.781870 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:24.781983 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.781988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.782785 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.782788 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.783408 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.783416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.783865 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.783869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.783961 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.784002 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.784326 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.784333 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.784409 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.784488 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 06:17:24.792086 30347 raft_consensus.cc:1261] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:24.792398 30578 raft_consensus.cc:1261] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:24.792536 30906 consensus_queue.cc:1035] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:24.792944 30911 consensus_queue.cc:1035] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:24.797052 30931 mvcc.cc:205] Tried to move back new op lower bound from 7315797789864026112 to 7315797789162098688. Current Snapshot: MvccSnapshot[applied={T|T < 7315797789864026112}]
I20260807 06:17:24.800325 30935 mvcc.cc:205] Tried to move back new op lower bound from 7315797789864026112 to 7315797789162098688. Current Snapshot: MvccSnapshot[applied={T|T < 7315797789864026112}]
I20260807 06:17:24.816655 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.812790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:39641 (local address 127.26.252.67:39543)
0807 06:17:24.812918 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.812921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.812934 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:24.813084 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.813086 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.813125 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.813205 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.813509 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.814181 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.815606 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.815824 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.815905 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.816211 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.816275 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.816352 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.816455 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.816510 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:24.817067 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.812511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:39543 (local address 127.26.252.66:39641)
0807 06:17:24.812869 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.812886 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.812985 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.813227 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.813230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.813238 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:24.813364 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.813370 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.814390 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.814393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.815485 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.815497 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.815931 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.815935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.816034 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.816088 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.816359 (+ 271us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.816365 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.816433 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.816514 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":112,"threads_started":1}
I20260807 06:17:24.844636 30130 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:24.844857 30130 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:24.847838 30130 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Sending DeleteTablet for 3 replicas of tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7
I20260807 06:17:24.848644 30551 tablet_service.cc:1514] Processing DeleteTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:24 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51084
I20260807 06:17:24.848878 30329 tablet_service.cc:1514] Processing DeleteTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:24 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:36586
I20260807 06:17:24.849459 30764 tablet_service.cc:1514] Processing DeleteTablet for tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:24 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47538
I20260807 06:17:24.850067 30959 tablet_replica.cc:330] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: stopping tablet replica
I20260807 06:17:24.850127 30130 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:17:24.850298 30962 tablet_replica.cc:330] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: stopping tablet replica
W20260807 06:17:24.850598 30130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:24.850646 30962 raft_consensus.cc:2229] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:24.851023 30962 raft_consensus.cc:2258] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:24.852006 30959 raft_consensus.cc:2229] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:24.852243 30959 raft_consensus.cc:2258] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:24.853809 30959 ts_tablet_manager.cc:1905] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:24.855312 30962 ts_tablet_manager.cc:1905] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:24.855914 30551 tablet_service.cc:1467] Processing CreateTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 (DEFAULT_TABLE table=test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.856192 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d794999a6a47e5a43d1b020118f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.858384 30329 tablet_service.cc:1467] Processing CreateTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 (DEFAULT_TABLE table=test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.858619 30961 tablet_replica.cc:330] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: stopping tablet replica
I20260807 06:17:24.858639 30959 ts_tablet_manager.cc:1918] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:24.858687 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d794999a6a47e5a43d1b020118f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.858737 30959 log.cc:1196] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/dd72f646ca3e4b9bbaa83e0eb8a44fb7
I20260807 06:17:24.858960 30961 raft_consensus.cc:2229] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:24.859099 30959 ts_tablet_manager.cc:1939] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 6dd7d348032a483d811bf151e8b0f041: Deleting consensus metadata
I20260807 06:17:24.859189 30961 raft_consensus.cc:2258] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:24.857678 30764 tablet_service.cc:1467] Processing CreateTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 (DEFAULT_TABLE table=test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:24.859740 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19d794999a6a47e5a43d1b020118f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:24.862311 30898 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Bootstrap starting.
I20260807 06:17:24.862324 30900 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Bootstrap starting.
I20260807 06:17:24.863349 30900 tablet_bootstrap.cc:654] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.863381 30898 tablet_bootstrap.cc:654] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.864250 30896 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Bootstrap starting.
I20260807 06:17:24.865187 30896 tablet_bootstrap.cc:654] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:24.867238 30962 ts_tablet_manager.cc:1918] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:24.867403 30962 log.cc:1196] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/dd72f646ca3e4b9bbaa83e0eb8a44fb7
I20260807 06:17:24.867817 30962 ts_tablet_manager.cc:1939] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 0d653f7c041f433c80b372ce4d0d5127: Deleting consensus metadata
I20260807 06:17:24.868402 30896 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: No bootstrap required, opened a new log
I20260807 06:17:24.868511 30896 ts_tablet_manager.cc:1397] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:17:24.868996 30896 raft_consensus.cc:348] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.869110 30896 raft_consensus.cc:374] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.869140 30896 raft_consensus.cc:729] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d303cf7b364a88a64b89a39cae92ec, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.869175 30106 catalog_manager.cc:4841] TS 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543): tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (table test-table [id=ac831e2800634c959fccd62042ae3588]) successfully deleted
I20260807 06:17:24.869262 30896 consensus_queue.cc:260] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.869540 30896 ts_tablet_manager.cc:1428] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.870280 30106 catalog_manager.cc:4841] TS 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823): tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (table test-table [id=ac831e2800634c959fccd62042ae3588]) successfully deleted
I20260807 06:17:24.871543 30898 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: No bootstrap required, opened a new log
I20260807 06:17:24.871634 30898 ts_tablet_manager.cc:1397] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260807 06:17:24.871728 30961 ts_tablet_manager.cc:1905] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:24.872115 30898 raft_consensus.cc:348] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.872267 30898 raft_consensus.cc:374] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.872301 30898 raft_consensus.cc:729] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.872434 30898 consensus_queue.cc:260] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.872725 30898 ts_tablet_manager.cc:1428] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.875001 30961 ts_tablet_manager.cc:1918] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:24.875170 30961 log.cc:1196] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/dd72f646ca3e4b9bbaa83e0eb8a44fb7
I20260807 06:17:24.875334 30900 tablet_bootstrap.cc:492] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: No bootstrap required, opened a new log
I20260807 06:17:24.875435 30900 ts_tablet_manager.cc:1397] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260807 06:17:24.875593 30961 ts_tablet_manager.cc:1939] T dd72f646ca3e4b9bbaa83e0eb8a44fb7 P 13d303cf7b364a88a64b89a39cae92ec: Deleting consensus metadata
I20260807 06:17:24.875905 30900 raft_consensus.cc:348] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.876017 30900 raft_consensus.cc:374] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:24.876047 30900 raft_consensus.cc:729] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Initialized, Role: FOLLOWER
I20260807 06:17:24.876189 30900 consensus_queue.cc:260] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.876467 30900 ts_tablet_manager.cc:1428] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:24.879187 30107 catalog_manager.cc:4841] TS 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037): tablet dd72f646ca3e4b9bbaa83e0eb8a44fb7 (table test-table [id=ac831e2800634c959fccd62042ae3588]) successfully deleted
I20260807 06:17:24.954231 30925 raft_consensus.cc:482] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:24.954370 30925 raft_consensus.cc:504] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.954885 30925 leader_election.cc:288] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543)
I20260807 06:17:24.955309 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19d794999a6a47e5a43d1b020118f9a4" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec" is_pre_election: true
I20260807 06:17:24.955395 30793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19d794999a6a47e5a43d1b020118f9a4" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d653f7c041f433c80b372ce4d0d5127" is_pre_election: true
I20260807 06:17:24.955479 30347 raft_consensus.cc:2454] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 0.
I20260807 06:17:24.955534 30793 raft_consensus.cc:2454] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 0.
I20260807 06:17:24.955853 30473 leader_election.cc:302] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.956107 30925 raft_consensus.cc:2781] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:24.956176 30925 raft_consensus.cc:482] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:24.956223 30925 raft_consensus.cc:3037] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.957703 30925 raft_consensus.cc:504] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.958123 30925 leader_election.cc:288] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 election: Requested vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543)
I20260807 06:17:24.958674 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19d794999a6a47e5a43d1b020118f9a4" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec"
I20260807 06:17:24.958726 30793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19d794999a6a47e5a43d1b020118f9a4" candidate_uuid: "6dd7d348032a483d811bf151e8b0f041" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d653f7c041f433c80b372ce4d0d5127"
I20260807 06:17:24.958839 30793 raft_consensus.cc:3037] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.958837 30347 raft_consensus.cc:3037] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:24.960084 30793 raft_consensus.cc:2454] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 1.
I20260807 06:17:24.960084 30347 raft_consensus.cc:2454] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dd7d348032a483d811bf151e8b0f041 in term 1.
I20260807 06:17:24.960472 30474 leader_election.cc:302] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d303cf7b364a88a64b89a39cae92ec, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:24.960683 30925 raft_consensus.cc:2781] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:24.960821 30925 raft_consensus.cc:686] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 1 LEADER]: Becoming Leader. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Running, Role: LEADER
I20260807 06:17:24.960978 30925 consensus_queue.cc:237] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:24.963019 30130 catalog_manager.cc:5495] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "6dd7d348032a483d811bf151e8b0f041" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:24.987738 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.983768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.26.252.66:38823)
0807 06:17:24.983896 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.983900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.983958 (+ 58us) server_negotiation.cc:407] Connection header received
0807 06:17:24.984099 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.984103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.984165 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.984263 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.984545 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.985437 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.986333 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.986737 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.986868 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.987100 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.987203 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.987291 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.987518 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.987590 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:24.998102 30953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.994253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38823 (local address 127.26.252.66:50079)
0807 06:17:24.994512 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:24.994527 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:24.994611 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:24.994868 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:24.994870 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:24.994877 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:24.994964 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.994968 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.996109 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.996113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.996700 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:24.996708 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.997318 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.997322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:24.997434 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.997473 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.997817 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.997824 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:17:24.997863 (+ 39us) client_negotiation.cc:240] Negotiation successful
0807 06:17:24.997950 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 06:17:24.998507 30888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:24.994304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:50079 (local address 127.26.252.66:38823)
0807 06:17:24.994450 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:24.994455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:24.994596 (+ 141us) server_negotiation.cc:407] Connection header received
0807 06:17:24.994706 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:24.994709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:24.994759 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:24.994850 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:24.995077 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.995932 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.996832 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:24.997165 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:24.997278 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:24.997618 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:24.997697 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:24.998288 (+ 591us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:24.998320 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 06:17:24.998371 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:17:25.011652 30793 raft_consensus.cc:1261] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Refusing update from remote peer 6dd7d348032a483d811bf151e8b0f041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:25.012082 30909 consensus_queue.cc:1035] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:25.012679 30347 raft_consensus.cc:1261] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Refusing update from remote peer 6dd7d348032a483d811bf151e8b0f041: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:25.014015 30909 consensus_queue.cc:1035] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:25.016425 30932 mvcc.cc:205] Tried to move back new op lower bound from 7315797790763581440 to 7315797790561837056. Current Snapshot: MvccSnapshot[applied={T|T < 7315797790763581440}]
W20260807 06:17:25.030838 30931 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:17:26.588693 30136 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:26.588893 30136 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:26.591248 30136 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Sending DeleteTablet for 3 replicas of tablet 19d794999a6a47e5a43d1b020118f9a4
I20260807 06:17:26.591832 30551 tablet_service.cc:1514] Processing DeleteTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51084
I20260807 06:17:26.591854 30329 tablet_service.cc:1514] Processing DeleteTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:36586
I20260807 06:17:26.591964 30764 tablet_service.cc:1514] Processing DeleteTablet for tablet 19d794999a6a47e5a43d1b020118f9a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47538
I20260807 06:17:26.592232 31003 tablet_replica.cc:330] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: stopping tablet replica
I20260807 06:17:26.592352 31004 tablet_replica.cc:330] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: stopping tablet replica
I20260807 06:17:26.592561 31004 raft_consensus.cc:2229] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:26.592559 31003 raft_consensus.cc:2229] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:26.592732 31004 raft_consensus.cc:2258] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.593014 31006 tablet_replica.cc:330] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: stopping tablet replica
I20260807 06:17:26.593191 31006 raft_consensus.cc:2229] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:26.593336 31006 raft_consensus.cc:2258] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.593472 31004 ts_tablet_manager.cc:1905] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.595570 31006 ts_tablet_manager.cc:1905] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.596072 31004 ts_tablet_manager.cc:1918] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:17:26.596127 31004 log.cc:1196] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/19d794999a6a47e5a43d1b020118f9a4
I20260807 06:17:26.596352 31004 ts_tablet_manager.cc:1939] T 19d794999a6a47e5a43d1b020118f9a4 P 13d303cf7b364a88a64b89a39cae92ec: Deleting consensus metadata
I20260807 06:17:26.596649 31003 raft_consensus.cc:2258] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.597046 30107 catalog_manager.cc:4841] TS 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037): tablet 19d794999a6a47e5a43d1b020118f9a4 (table test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]) successfully deleted
I20260807 06:17:26.597345 31003 ts_tablet_manager.cc:1905] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.598189 31006 ts_tablet_manager.cc:1918] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:17:26.598290 31006 log.cc:1196] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/19d794999a6a47e5a43d1b020118f9a4
I20260807 06:17:26.598629 31006 ts_tablet_manager.cc:1939] T 19d794999a6a47e5a43d1b020118f9a4 P 0d653f7c041f433c80b372ce4d0d5127: Deleting consensus metadata
I20260807 06:17:26.599371 30106 catalog_manager.cc:4841] TS 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543): tablet 19d794999a6a47e5a43d1b020118f9a4 (table test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]) successfully deleted
I20260807 06:17:26.599920 31003 ts_tablet_manager.cc:1918] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:17:26.600013 31003 log.cc:1196] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/19d794999a6a47e5a43d1b020118f9a4
I20260807 06:17:26.600307 31003 ts_tablet_manager.cc:1939] T 19d794999a6a47e5a43d1b020118f9a4 P 6dd7d348032a483d811bf151e8b0f041: Deleting consensus metadata
I20260807 06:17:26.600898 30106 catalog_manager.cc:4841] TS 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823): tablet 19d794999a6a47e5a43d1b020118f9a4 (table test-table [id=1aa0a50a4c8d48e6939e8ddaa1e9784d]) successfully deleted
Aug 07 06:17:26 dist-test-slave-68xk krb5kdc[30067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083446, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:17:26 dist-test-slave-68xk krb5kdc[30067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083446, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:26.625682 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:26.616447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39076 (local address 127.26.252.126:40157)
0807 06:17:26.616748 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:26.616757 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:26.616812 (+ 55us) server_negotiation.cc:407] Connection header received
0807 06:17:26.616984 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:26.616987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:26.617043 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:26.617147 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:26.617851 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:26.618470 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:26.619315 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:26.619565 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:26.619674 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:26.622199 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:26.622207 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:26.622213 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:26.622244 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:26.623902 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:26.624361 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:26.624365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:26.624367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:26.624461 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:26.624761 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:26.624764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:26.624766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:26.624955 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:26.625123 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:26.625359 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 06:17:26.625492 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":114,"threads_started":1}
I20260807 06:17:26.628163 30136 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:26.628640 30136 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:26.633574 30551 tablet_service.cc:1467] Processing CreateTablet for tablet fa678f6360d347c189674f5d09a0f85e (DEFAULT_TABLE table=test-table [id=dc45d468bb4845f48d159f8b6f8adb69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.633635 30329 tablet_service.cc:1467] Processing CreateTablet for tablet fa678f6360d347c189674f5d09a0f85e (DEFAULT_TABLE table=test-table [id=dc45d468bb4845f48d159f8b6f8adb69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.633634 30764 tablet_service.cc:1467] Processing CreateTablet for tablet fa678f6360d347c189674f5d09a0f85e (DEFAULT_TABLE table=test-table [id=dc45d468bb4845f48d159f8b6f8adb69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.633934 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa678f6360d347c189674f5d09a0f85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.633939 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa678f6360d347c189674f5d09a0f85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.633953 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa678f6360d347c189674f5d09a0f85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.636346 31017 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Bootstrap starting.
I20260807 06:17:26.636693 31020 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Bootstrap starting.
I20260807 06:17:26.636910 31018 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Bootstrap starting.
I20260807 06:17:26.637388 31017 tablet_bootstrap.cc:654] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.637621 31020 tablet_bootstrap.cc:654] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.637998 31018 tablet_bootstrap.cc:654] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.638804 31017 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: No bootstrap required, opened a new log
I20260807 06:17:26.638988 31017 ts_tablet_manager.cc:1397] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:26.639470 31018 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: No bootstrap required, opened a new log
I20260807 06:17:26.639564 31018 ts_tablet_manager.cc:1397] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:26.639495 31017 raft_consensus.cc:348] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.639580 31020 tablet_bootstrap.cc:492] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: No bootstrap required, opened a new log
I20260807 06:17:26.639606 31017 raft_consensus.cc:374] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.639642 31017 raft_consensus.cc:729] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.639664 31020 ts_tablet_manager.cc:1397] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:26.639772 31017 consensus_queue.cc:260] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.639999 31018 raft_consensus.cc:348] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.640100 31018 raft_consensus.cc:374] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.640132 31018 raft_consensus.cc:729] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.640177 31020 raft_consensus.cc:348] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.640251 31018 consensus_queue.cc:260] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.640311 31020 raft_consensus.cc:374] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.640348 31020 raft_consensus.cc:729] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d303cf7b364a88a64b89a39cae92ec, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.640528 31017 ts_tablet_manager.cc:1428] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:26.640497 31020 consensus_queue.cc:260] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.640596 31018 ts_tablet_manager.cc:1428] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:26.640887 31020 ts_tablet_manager.cc:1428] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:26.652753 31026 raft_consensus.cc:482] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:26.652884 31026 raft_consensus.cc:504] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.653275 31026 leader_election.cc:288] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823)
I20260807 06:17:26.653635 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa678f6360d347c189674f5d09a0f85e" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec" is_pre_election: true
I20260807 06:17:26.653635 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa678f6360d347c189674f5d09a0f85e" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041" is_pre_election: true
I20260807 06:17:26.653771 30347 raft_consensus.cc:2454] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:26.653771 30578 raft_consensus.cc:2454] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:26.654054 30698 leader_election.cc:302] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 13d303cf7b364a88a64b89a39cae92ec; no voters:
I20260807 06:17:26.654232 31026 raft_consensus.cc:2781] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:26.654296 31026 raft_consensus.cc:482] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:26.654333 31026 raft_consensus.cc:3037] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.655270 31026 raft_consensus.cc:504] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.655583 31026 leader_election.cc:288] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Requested vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823)
I20260807 06:17:26.655835 30347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa678f6360d347c189674f5d09a0f85e" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec"
I20260807 06:17:26.655964 30347 raft_consensus.cc:3037] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.655941 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa678f6360d347c189674f5d09a0f85e" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041"
I20260807 06:17:26.656049 30578 raft_consensus.cc:3037] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.657097 30347 raft_consensus.cc:2454] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:26.657171 30578 raft_consensus.cc:2454] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:26.657387 30698 leader_election.cc:302] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 13d303cf7b364a88a64b89a39cae92ec; no voters:
I20260807 06:17:26.657588 31026 raft_consensus.cc:2781] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:26.657804 31026 raft_consensus.cc:686] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Becoming Leader. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Running, Role: LEADER
I20260807 06:17:26.657953 31026 consensus_queue.cc:237] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.659566 30136 catalog_manager.cc:5495] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "0d653f7c041f433c80b372ce4d0d5127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } health_report { overall_health: HEALTHY } } }
I20260807 06:17:26.678267 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:26.674932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.26.252.67:39543)
0807 06:17:26.675186 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:26.675194 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:26.675207 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:26.675248 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:26.675250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:26.675291 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:26.675372 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:26.675613 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:26.676328 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:26.677165 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:26.677465 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:26.677567 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:26.677796 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:26.677869 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:26.677928 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:26.678005 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:17:26.678053 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
I20260807 06:17:26.684850 30347 raft_consensus.cc:1261] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:26.684850 30578 raft_consensus.cc:1261] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:26.685243 31026 consensus_queue.cc:1035] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:26.685452 31028 consensus_queue.cc:1035] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:26.717464 30133 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:26.717617 30133 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:26.719678 30133 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Sending DeleteTablet for 3 replicas of tablet fa678f6360d347c189674f5d09a0f85e
I20260807 06:17:26.720242 30329 tablet_service.cc:1514] Processing DeleteTablet for tablet fa678f6360d347c189674f5d09a0f85e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:36586
I20260807 06:17:26.720384 30551 tablet_service.cc:1514] Processing DeleteTablet for tablet fa678f6360d347c189674f5d09a0f85e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51084
I20260807 06:17:26.720438 31004 tablet_replica.cc:330] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: stopping tablet replica
I20260807 06:17:26.720559 31004 raft_consensus.cc:2229] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:26.720588 31003 tablet_replica.cc:330] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: stopping tablet replica
I20260807 06:17:26.720676 31004 raft_consensus.cc:2258] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.720727 31003 raft_consensus.cc:2229] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:26.720831 31003 raft_consensus.cc:2258] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.720858 30764 tablet_service.cc:1514] Processing DeleteTablet for tablet fa678f6360d347c189674f5d09a0f85e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:26 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47538
I20260807 06:17:26.721028 31006 tablet_replica.cc:330] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: stopping tablet replica
I20260807 06:17:26.721169 31006 raft_consensus.cc:2229] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:26.721333 31006 raft_consensus.cc:2258] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:26.721477 31003 ts_tablet_manager.cc:1905] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.722023 31004 ts_tablet_manager.cc:1905] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.724086 31004 ts_tablet_manager.cc:1918] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:26.724200 31004 log.cc:1196] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/fa678f6360d347c189674f5d09a0f85e
I20260807 06:17:26.724210 31003 ts_tablet_manager.cc:1918] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:26.724277 31003 log.cc:1196] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/fa678f6360d347c189674f5d09a0f85e
I20260807 06:17:26.724485 31004 ts_tablet_manager.cc:1939] T fa678f6360d347c189674f5d09a0f85e P 13d303cf7b364a88a64b89a39cae92ec: Deleting consensus metadata
I20260807 06:17:26.724646 31003 ts_tablet_manager.cc:1939] T fa678f6360d347c189674f5d09a0f85e P 6dd7d348032a483d811bf151e8b0f041: Deleting consensus metadata
I20260807 06:17:26.725215 30107 catalog_manager.cc:4841] TS 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037): tablet fa678f6360d347c189674f5d09a0f85e (table test-table [id=dc45d468bb4845f48d159f8b6f8adb69]) successfully deleted
I20260807 06:17:26.725483 31006 ts_tablet_manager.cc:1905] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:26.725505 30106 catalog_manager.cc:4841] TS 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823): tablet fa678f6360d347c189674f5d09a0f85e (table test-table [id=dc45d468bb4845f48d159f8b6f8adb69]) successfully deleted
I20260807 06:17:26.727464 30133 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:17:26.727840 31006 ts_tablet_manager.cc:1918] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
W20260807 06:17:26.727866 30133 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:26.727936 31006 log.cc:1196] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/fa678f6360d347c189674f5d09a0f85e
I20260807 06:17:26.728173 31006 ts_tablet_manager.cc:1939] T fa678f6360d347c189674f5d09a0f85e P 0d653f7c041f433c80b372ce4d0d5127: Deleting consensus metadata
I20260807 06:17:26.728945 30106 catalog_manager.cc:4841] TS 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543): tablet fa678f6360d347c189674f5d09a0f85e (table test-table [id=dc45d468bb4845f48d159f8b6f8adb69]) successfully deleted
I20260807 06:17:26.732462 30329 tablet_service.cc:1467] Processing CreateTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 (DEFAULT_TABLE table=test-table [id=c945dbb1e8924c63a23df18485396673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.732599 30764 tablet_service.cc:1467] Processing CreateTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 (DEFAULT_TABLE table=test-table [id=c945dbb1e8924c63a23df18485396673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.732749 30329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.732829 30764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.734774 30551 tablet_service.cc:1467] Processing CreateTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 (DEFAULT_TABLE table=test-table [id=c945dbb1e8924c63a23df18485396673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:26.735060 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:26.735213 31018 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Bootstrap starting.
I20260807 06:17:26.736060 31018 tablet_bootstrap.cc:654] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.737061 31017 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Bootstrap starting.
I20260807 06:17:26.737192 31018 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: No bootstrap required, opened a new log
I20260807 06:17:26.737286 31018 ts_tablet_manager.cc:1397] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:26.737603 31018 raft_consensus.cc:348] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.737686 31018 raft_consensus.cc:374] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.737706 31018 raft_consensus.cc:729] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.737836 31018 consensus_queue.cc:260] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.737917 31017 tablet_bootstrap.cc:654] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.738140 31018 ts_tablet_manager.cc:1428] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:26.738323 31020 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: Bootstrap starting.
I20260807 06:17:26.739212 31017 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: No bootstrap required, opened a new log
I20260807 06:17:26.739305 31017 ts_tablet_manager.cc:1397] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:26.739326 31020 tablet_bootstrap.cc:654] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:26.739756 31017 raft_consensus.cc:348] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.739877 31017 raft_consensus.cc:374] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.739916 31017 raft_consensus.cc:729] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd7d348032a483d811bf151e8b0f041, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.740052 31017 consensus_queue.cc:260] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.740351 31017 ts_tablet_manager.cc:1428] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:26.741113 31020 tablet_bootstrap.cc:492] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: No bootstrap required, opened a new log
I20260807 06:17:26.741189 31020 ts_tablet_manager.cc:1397] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:26.741619 31020 raft_consensus.cc:348] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.741756 31020 raft_consensus.cc:374] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:26.741803 31020 raft_consensus.cc:729] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d303cf7b364a88a64b89a39cae92ec, State: Initialized, Role: FOLLOWER
I20260807 06:17:26.741940 31020 consensus_queue.cc:260] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.742223 31020 ts_tablet_manager.cc:1428] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:26.816287 31039 raft_consensus.cc:482] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:26.816433 31039 raft_consensus.cc:504] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.816939 31039 leader_election.cc:288] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823)
I20260807 06:17:26.817485 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ef57fa3dd14c4a86e9c6881a7c59e9" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041" is_pre_election: true
I20260807 06:17:26.817508 30358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ef57fa3dd14c4a86e9c6881a7c59e9" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec" is_pre_election: true
I20260807 06:17:26.817669 30358 raft_consensus.cc:2454] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:26.817669 30578 raft_consensus.cc:2454] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 0.
I20260807 06:17:26.818007 30697 leader_election.cc:302] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:26.818297 31039 raft_consensus.cc:2781] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:26.818365 31039 raft_consensus.cc:482] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:26.818449 31039 raft_consensus.cc:3037] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.819561 31039 raft_consensus.cc:504] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.819909 31039 leader_election.cc:288] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Requested vote from peers 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037), 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823)
I20260807 06:17:26.820330 30358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ef57fa3dd14c4a86e9c6881a7c59e9" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d303cf7b364a88a64b89a39cae92ec"
I20260807 06:17:26.820350 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24ef57fa3dd14c4a86e9c6881a7c59e9" candidate_uuid: "0d653f7c041f433c80b372ce4d0d5127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd7d348032a483d811bf151e8b0f041"
I20260807 06:17:26.820468 30358 raft_consensus.cc:3037] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.820469 30578 raft_consensus.cc:3037] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:26.821729 30358 raft_consensus.cc:2454] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:26.821729 30578 raft_consensus.cc:2454] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d653f7c041f433c80b372ce4d0d5127 in term 1.
I20260807 06:17:26.822099 30697 leader_election.cc:302] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d653f7c041f433c80b372ce4d0d5127, 13d303cf7b364a88a64b89a39cae92ec, 6dd7d348032a483d811bf151e8b0f041; no voters:
I20260807 06:17:26.822338 31039 raft_consensus.cc:2781] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:26.822471 31039 raft_consensus.cc:686] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Becoming Leader. State: Replica: 0d653f7c041f433c80b372ce4d0d5127, State: Running, Role: LEADER
I20260807 06:17:26.822640 31039 consensus_queue.cc:237] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } }
I20260807 06:17:26.824441 30133 catalog_manager.cc:5495] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "0d653f7c041f433c80b372ce4d0d5127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d653f7c041f433c80b372ce4d0d5127" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39543 } health_report { overall_health: HEALTHY } } }
I20260807 06:17:26.846613 30578 raft_consensus.cc:1261] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:26.847018 30358 raft_consensus.cc:1261] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec [term 1 FOLLOWER]: Refusing update from remote peer 0d653f7c041f433c80b372ce4d0d5127: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:26.847028 31028 consensus_queue.cc:1035] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dd7d348032a483d811bf151e8b0f041" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:26.847446 31028 consensus_queue.cc:1035] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d303cf7b364a88a64b89a39cae92ec" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 40037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:17:26.860494 30984 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:17:28.412174 30136 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:28.412349 30136 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:28.414924 30136 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8786942346e2493b950f588ea8049d6e: Sending DeleteTablet for 3 replicas of tablet 24ef57fa3dd14c4a86e9c6881a7c59e9
I20260807 06:17:28.415581 30329 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:28 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:36586
I20260807 06:17:28.415602 30551 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:28 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:51084
I20260807 06:17:28.415699 30764 tablet_service.cc:1514] Processing DeleteTablet for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:28 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47538
I20260807 06:17:28.415985 31090 tablet_replica.cc:330] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 13d303cf7b364a88a64b89a39cae92ec: stopping tablet replica
I20260807 06:17:28.416011 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 30238
I20260807 06:17:28.420892 31089 tablet_replica.cc:330] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: stopping tablet replica
I20260807 06:17:28.421175 31089 raft_consensus.cc:2229] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:28.421336 31089 raft_consensus.cc:2258] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:28.421627 31091 tablet_replica.cc:330] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: stopping tablet replica
I20260807 06:17:28.421850 31091 raft_consensus.cc:2229] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:28.422112 31091 raft_consensus.cc:2258] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:28.422209 31089 ts_tablet_manager.cc:1905] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:28.422991 31091 ts_tablet_manager.cc:1905] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:28.425153 31091 ts_tablet_manager.cc:1918] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:17:28.425256 31091 log.cc:1196] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/24ef57fa3dd14c4a86e9c6881a7c59e9
I20260807 06:17:28.425581 31091 ts_tablet_manager.cc:1939] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 0d653f7c041f433c80b372ce4d0d5127: Deleting consensus metadata
I20260807 06:17:28.425932 31089 ts_tablet_manager.cc:1918] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:17:28.426021 31089 log.cc:1196] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/24ef57fa3dd14c4a86e9c6881a7c59e9
I20260807 06:17:28.426348 31089 ts_tablet_manager.cc:1939] T 24ef57fa3dd14c4a86e9c6881a7c59e9 P 6dd7d348032a483d811bf151e8b0f041: Deleting consensus metadata
I20260807 06:17:28.426319 30106 catalog_manager.cc:4841] TS 0d653f7c041f433c80b372ce4d0d5127 (127.26.252.67:39543): tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 (table test-table [id=c945dbb1e8924c63a23df18485396673]) successfully deleted
I20260807 06:17:28.427253 30106 catalog_manager.cc:4841] TS 6dd7d348032a483d811bf151e8b0f041 (127.26.252.66:38823): tablet 24ef57fa3dd14c4a86e9c6881a7c59e9 (table test-table [id=c945dbb1e8924c63a23df18485396673]) successfully deleted
W20260807 06:17:28.429340 30107 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:40037 (error 108)
I20260807 06:17:28.429535 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 30448
I20260807 06:17:28.433454 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:28.432201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:40037 (local address 127.0.0.1:36588)
0807 06:17:28.433218 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:28.433318 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:40037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":901,"thread_start_us":796,"threads_started":1}
W20260807 06:17:28.433732 30107 catalog_manager.cc:4584] TS 13d303cf7b364a88a64b89a39cae92ec (127.26.252.65:40037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 24ef57fa3dd14c4a86e9c6881a7c59e9: Network error: Client connection negotiation failed: client connection to 127.26.252.65:40037: connect: Connection refused (error 111)
I20260807 06:17:28.441035 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 30666
I20260807 06:17:28.451553 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 30080
2026-08-07T06:17:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6261 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:28 dist-test-slave-68xk krb5kdc[31099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:28 dist-test-slave-68xk krb5kdc[31099](info): set up 2 sockets
Aug 07 06:17:28 dist-test-slave-68xk krb5kdc[31099](info): commencing operation
krb5kdc: starting...
W20260807 06:17:29.697796 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:29 dist-test-slave-68xk krb5kdc[31099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:29.827800 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46419
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:46419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:29.941315 31117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:29.941577 31117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:29.941617 31117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:29.945501 31117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:29.945554 31117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:29.945573 31117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:29.945590 31117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:29.945604 31117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:29.950680 31117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:46419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:29.951627 31117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:29.952584 31117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:29.961501 31123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:29.961565 31125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:29.961547 31117 server_base.cc:1034] running on GCE node
W20260807 06:17:29.961666 31122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:29.962494 31117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:29.963676 31117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:29.965021 31117 hybrid_clock.cc:648] HybridClock initialized: now 1786083449965004 us; error 39 us; skew 500 ppm
Aug 07 06:17:29 dist-test-slave-68xk krb5kdc[31099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083449, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:29.970856 31117 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:29.971707 31117 webserver.cc:460] Webserver started at http://127.26.252.126:38553/ using document root <none> and password file <none>
I20260807 06:17:29.972239 31117 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:29.972297 31117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:29.972466 31117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:29.974622 31117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "c70020d0f29445818b21d8ec3908c319"
format_stamp: "Formatted at 2026-08-07 06:17:29 on dist-test-slave-68xk"
server_key: "6bef6c3f68c6d62f614b191e2f6bcc42"
server_key_iv: "392e999941e396813d104c13b6bdea0c"
server_key_version: "encryptionkey@0"
I20260807 06:17:29.975154 31117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "c70020d0f29445818b21d8ec3908c319"
format_stamp: "Formatted at 2026-08-07 06:17:29 on dist-test-slave-68xk"
server_key: "6bef6c3f68c6d62f614b191e2f6bcc42"
server_key_iv: "392e999941e396813d104c13b6bdea0c"
server_key_version: "encryptionkey@0"
I20260807 06:17:29.978902 31117 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:29.981312 31138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:29.982810 31117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:29.982957 31117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "c70020d0f29445818b21d8ec3908c319"
format_stamp: "Formatted at 2026-08-07 06:17:29 on dist-test-slave-68xk"
server_key: "6bef6c3f68c6d62f614b191e2f6bcc42"
server_key_iv: "392e999941e396813d104c13b6bdea0c"
server_key_version: "encryptionkey@0"
I20260807 06:17:29.983065 31117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:30.017409 31117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:30.020766 31117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:30.020985 31117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:30.028604 31117 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:46419
I20260807 06:17:30.028656 31209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:46419 every 8 connection(s)
I20260807 06:17:30.029589 31117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:30.032389 31211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:30.034276 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 31117
I20260807 06:17:30.034395 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:30.034708 27633 external_mini_cluster.cc:1428] Setting key 41c5461542ecfc054b6133340541e668
I20260807 06:17:30.038913 31211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319: Bootstrap starting.
I20260807 06:17:30.041160 31211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:30.041983 31211 log.cc:824] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:30.044140 31211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319: No bootstrap required, opened a new log
I20260807 06:17:30.047626 31211 raft_consensus.cc:348] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } }
I20260807 06:17:30.047844 31211 raft_consensus.cc:374] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:30.047922 31211 raft_consensus.cc:729] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70020d0f29445818b21d8ec3908c319, State: Initialized, Role: FOLLOWER
I20260807 06:17:30.048377 31211 consensus_queue.cc:260] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } }
I20260807 06:17:30.048529 31211 raft_consensus.cc:388] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:30.048650 31211 raft_consensus.cc:482] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:30.048780 31211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:30.049749 31211 raft_consensus.cc:504] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } }
I20260807 06:17:30.050053 31216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.036171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.26.252.126:46419)
0807 06:17:30.036616 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:30.036630 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:30.036665 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:30.037326 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:30.037342 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:30.037675 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:30.038009 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:30.038881 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.039884 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.040787 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.041305 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.041475 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.044416 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:30.044421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:30.044434 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:30.044460 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:30.047103 (+ 2643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.047570 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.047575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.047579 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.047689 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.048031 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.048037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.048038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.048413 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:30.048653 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:30.048955 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 06:17:30.049265 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":141,"threads_started":1}
I20260807 06:17:30.050081 31211 leader_election.cc:302] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c70020d0f29445818b21d8ec3908c319; no voters:
I20260807 06:17:30.050508 31211 leader_election.cc:288] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:30.050563 31219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:30.050745 31219 raft_consensus.cc:686] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [term 1 LEADER]: Becoming Leader. State: Replica: c70020d0f29445818b21d8ec3908c319, State: Running, Role: LEADER
I20260807 06:17:30.051098 31219 consensus_queue.cc:237] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } }
I20260807 06:17:30.051781 31211 sys_catalog.cc:564] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:30.052966 31227 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c70020d0f29445818b21d8ec3908c319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } } }
I20260807 06:17:30.053006 31221 sys_catalog.cc:455] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c70020d0f29445818b21d8ec3908c319. Latest consensus state: current_term: 1 leader_uuid: "c70020d0f29445818b21d8ec3908c319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c70020d0f29445818b21d8ec3908c319" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46419 } } }
I20260807 06:17:30.053097 31227 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:30.053174 31221 sys_catalog.cc:458] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:30.053586 31235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:30.056738 31235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:30.070142 31235 catalog_manager.cc:1347] Generated new cluster ID: 81d1a4e6cb2448099c352d2c734d8092
I20260807 06:17:30.070230 31235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:30.111460 31235 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:30.112805 31235 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:30.117779 31235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c70020d0f29445818b21d8ec3908c319: Generated new TSK 0
I20260807 06:17:30.118633 31235 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:30.156966 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:30.273701 31253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:30.273972 31253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:30.274044 31253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:30.277994 31253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:30.278086 31253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:30.278182 31253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:30.283396 31253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:30.284415 31253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:30.285445 31253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:30.295303 31265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:30.295315 31262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:30.295490 31253 server_base.cc:1034] running on GCE node
W20260807 06:17:30.295311 31261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:30.295944 31253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:30.296612 31253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:30.297784 31253 hybrid_clock.cc:648] HybridClock initialized: now 1786083450297759 us; error 36 us; skew 500 ppm
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:30.300581 31253 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:30.301543 31253 webserver.cc:460] Webserver started at http://127.26.252.65:35271/ using document root <none> and password file <none>
I20260807 06:17:30.302175 31253 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:30.302268 31253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:30.302541 31253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:30.304574 31253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "b105f85145444811b558e12b2c8c7cc0"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "377d6e393166365ae3b9a333d5ee6ceb"
server_key_iv: "aea6a32f024d500583e007286f18047e"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.305104 31253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "b105f85145444811b558e12b2c8c7cc0"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "377d6e393166365ae3b9a333d5ee6ceb"
server_key_iv: "aea6a32f024d500583e007286f18047e"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.308787 31253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 06:17:30.311313 31273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.312589 31253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:30.312732 31253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "b105f85145444811b558e12b2c8c7cc0"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "377d6e393166365ae3b9a333d5ee6ceb"
server_key_iv: "aea6a32f024d500583e007286f18047e"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.312853 31253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:30.347556 31253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:30.350996 31253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:30.351225 31253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:30.351913 31253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:30.352938 31253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:30.353011 31253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.353084 31253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:30.353129 31253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.362649 31253 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:46285
I20260807 06:17:30.362679 31441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:46285 every 8 connection(s)
I20260807 06:17:30.363623 31253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:30.364543 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 31253
I20260807 06:17:30.364679 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:30.364955 27633 external_mini_cluster.cc:1428] Setting key 1d5744131b4c1c70c9938919ffc446c1
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:30.380465 31216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.366180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:40909 (local address 127.26.252.126:46419)
0807 06:17:30.366325 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:30.366329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:30.367514 (+ 1185us) server_negotiation.cc:407] Connection header received
0807 06:17:30.368848 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:30.368851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:30.368904 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:30.368987 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:30.370508 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.371126 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.372942 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.373320 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.373420 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.376481 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:30.376486 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:30.376491 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:30.376526 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:30.378210 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.378822 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.378825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.378826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.378908 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.379306 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.379309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.379310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.379493 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:30.379570 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:30.380066 (+ 496us) server_negotiation.cc:299] Negotiation successful
0807 06:17:30.380185 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:30.381507 31447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.366769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46419 (local address 127.26.252.65:40909)
0807 06:17:30.367371 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:30.367414 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:30.368633 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:30.369163 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:30.369171 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:30.369529 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:30.370181 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.370205 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.371274 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.371282 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.372785 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.372801 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.373510 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.373514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.373743 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.374488 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:30.374507 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:30.376278 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:30.378346 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.378351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.378365 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.378726 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.379016 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.379022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.379026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.379201 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.379586 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:30.379592 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:30.379836 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 06:17:30.379996 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 06:17:30.380352 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":165,"threads_started":1}
I20260807 06:17:30.383055 31442 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46419
I20260807 06:17:30.383313 31442 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:30.383847 31442 heartbeater.cc:511] Master 127.26.252.126:46419 requested a full tablet report, sending...
I20260807 06:17:30.385659 31162 ts_manager.cc:194] Registered new tserver with Master: b105f85145444811b558e12b2c8c7cc0 (127.26.252.65:46285)
I20260807 06:17:30.387591 31162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:40909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:30.401755 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:30.515302 31451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:30.515539 31451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:30.515579 31451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:30.519749 31451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:30.519805 31451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:30.519861 31451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:30.524824 31451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:30.525766 31451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:30.526724 31451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:30.536103 31465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:30.536123 31463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:30.536109 31461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:30.536388 31451 server_base.cc:1034] running on GCE node
I20260807 06:17:30.536849 31451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:30.537446 31451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:30.538648 31451 hybrid_clock.cc:648] HybridClock initialized: now 1786083450538630 us; error 30 us; skew 500 ppm
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:30.541332 31451 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:30.542165 31451 webserver.cc:460] Webserver started at http://127.26.252.66:41351/ using document root <none> and password file <none>
I20260807 06:17:30.542815 31451 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:30.542914 31451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:30.543155 31451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:30.545192 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "92cecbcde4e84d529b8d69ff9e05bf23"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "e8ab1d4a2a3ffc96e59cc2688ef4f3e5"
server_key_iv: "6a8ec6263cae76543a908deba03c0bf6"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.545789 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "92cecbcde4e84d529b8d69ff9e05bf23"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "e8ab1d4a2a3ffc96e59cc2688ef4f3e5"
server_key_iv: "6a8ec6263cae76543a908deba03c0bf6"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.549549 31451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:30.552310 31479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.553830 31451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 06:17:30.553964 31451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "92cecbcde4e84d529b8d69ff9e05bf23"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "e8ab1d4a2a3ffc96e59cc2688ef4f3e5"
server_key_iv: "6a8ec6263cae76543a908deba03c0bf6"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.554072 31451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:30.562839 31451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:30.565433 31451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:30.565629 31451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:30.566192 31451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:30.567068 31451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:30.567143 31451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.567206 31451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:30.567258 31451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.576445 31451 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:43423
I20260807 06:17:30.576478 31630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:43423 every 8 connection(s)
I20260807 06:17:30.577397 31451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:30.578459 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 31451
I20260807 06:17:30.578599 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:30.578899 27633 external_mini_cluster.cc:1428] Setting key c28137600015d6bccfb6e842a4ded9cf
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:17:30.593341 31216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.579473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:41373 (local address 127.26.252.126:46419)
0807 06:17:30.579633 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:30.579639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:30.580701 (+ 1062us) server_negotiation.cc:407] Connection header received
0807 06:17:30.582618 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:30.582621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:30.582667 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:30.582774 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:30.583995 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.584543 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.585872 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.586108 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.586230 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.588986 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:30.588990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:30.588992 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:30.589016 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:30.590985 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.591543 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.591547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.591548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.591628 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.592000 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.592003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.592004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.592190 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:30.592321 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:30.592930 (+ 609us) server_negotiation.cc:299] Negotiation successful
0807 06:17:30.593071 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:17:30.594069 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.579955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46419 (local address 127.26.252.66:41373)
0807 06:17:30.580521 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:30.580580 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:30.582370 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:30.582967 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:30.582975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:30.583348 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:30.583839 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.583853 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.584677 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.584683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.585736 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.585747 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.586276 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.586281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.586526 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.587227 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:30.587245 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:30.588806 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:30.591158 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.591163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.591174 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.591432 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.591779 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.591781 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.591783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.591914 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.592300 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:30.592305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:30.592620 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 06:17:30.592841 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 06:17:30.593150 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":154,"threads_started":1}
I20260807 06:17:30.595443 31632 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46419
I20260807 06:17:30.595705 31632 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:30.596221 31632 heartbeater.cc:511] Master 127.26.252.126:46419 requested a full tablet report, sending...
I20260807 06:17:30.597374 31162 ts_manager.cc:194] Registered new tserver with Master: 92cecbcde4e84d529b8d69ff9e05bf23 (127.26.252.66:43423)
I20260807 06:17:30.597972 31162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:41373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:30.608937 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:30.721441 31639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:30.721776 31639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:30.721879 31639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:30.725934 31639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:30.726032 31639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:30.726156 31639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:30.731494 31639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:30.732596 31639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:30.733642 31639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:30.743388 31650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:30.743323 31653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:30.743512 31639 server_base.cc:1034] running on GCE node
W20260807 06:17:30.743340 31647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:30.743983 31639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:30.744675 31639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:30.745889 31639 hybrid_clock.cc:648] HybridClock initialized: now 1786083450745870 us; error 37 us; skew 500 ppm
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:30.748821 31639 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:30.749711 31639 webserver.cc:460] Webserver started at http://127.26.252.67:36573/ using document root <none> and password file <none>
I20260807 06:17:30.750313 31639 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:30.750409 31639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:30.750698 31639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:30.752986 31639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "9998fcfe1c22432eb53d17279b25315b"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "81d3aeda7137d97797a5d1c6a8e8cbcd"
server_key_iv: "30609e9be23e3bd3fe1300930821dcb2"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.753618 31639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "9998fcfe1c22432eb53d17279b25315b"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "81d3aeda7137d97797a5d1c6a8e8cbcd"
server_key_iv: "30609e9be23e3bd3fe1300930821dcb2"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.757620 31639 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:17:30.760387 31663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.761608 31639 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 06:17:30.761759 31639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "9998fcfe1c22432eb53d17279b25315b"
format_stamp: "Formatted at 2026-08-07 06:17:30 on dist-test-slave-68xk"
server_key: "81d3aeda7137d97797a5d1c6a8e8cbcd"
server_key_iv: "30609e9be23e3bd3fe1300930821dcb2"
server_key_version: "encryptionkey@0"
I20260807 06:17:30.761874 31639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:30.774242 31639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:30.777240 31639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:30.777449 31639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:30.778070 31639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:30.779162 31639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:30.779212 31639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.779281 31639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:30.779313 31639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:30.789026 31639 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:37257
I20260807 06:17:30.789057 31813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:37257 every 8 connection(s)
I20260807 06:17:30.790261 31639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:30.795425 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 31639
I20260807 06:17:30.795528 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:30.795831 27633 external_mini_cluster.cc:1428] Setting key abf984f05b1df35dbd8ffbec82c2e1e7
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083450, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:30.804930 31216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.792125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:41625 (local address 127.26.252.126:46419)
0807 06:17:30.792320 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:30.792324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:30.793125 (+ 801us) server_negotiation.cc:407] Connection header received
0807 06:17:30.794504 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:30.794508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:30.794567 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:30.794677 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:30.796006 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.796585 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.798707 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.798925 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.799008 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.801589 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:30.801592 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:30.801594 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:30.801618 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:30.803068 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.803575 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.803577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.803578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.803653 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:30.804009 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:30.804012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:30.804013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:30.804176 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:30.804264 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:30.804712 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 06:17:30.804811 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:17:30.805742 31819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:30.792512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46419 (local address 127.26.252.67:41625)
0807 06:17:30.792967 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:30.793011 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:30.794267 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:30.794854 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:30.794862 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:30.795218 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:30.795794 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.795810 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.796775 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.796779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.798356 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:30.798370 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:30.799068 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:30.799071 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:30.799267 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:30.799832 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:30.799850 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:30.801431 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:30.803199 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.803204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.803215 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.803481 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.803783 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:30.803785 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:30.803787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:30.803926 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:30.804273 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:30.804277 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:30.804494 (+ 217us) client_negotiation.cc:769] Sending connection context
0807 06:17:30.804648 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 06:17:30.804896 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":134,"threads_started":1}
I20260807 06:17:30.806874 31814 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46419
I20260807 06:17:30.807109 31814 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:30.807587 31814 heartbeater.cc:511] Master 127.26.252.126:46419 requested a full tablet report, sending...
I20260807 06:17:30.808590 31162 ts_manager.cc:194] Registered new tserver with Master: 9998fcfe1c22432eb53d17279b25315b (127.26.252.67:37257)
I20260807 06:17:30.809320 31162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:41625
I20260807 06:17:30.811883 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:17:30.827577 31216 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:30.826000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55346 (local address 127.26.252.126:46419)
0807 06:17:30.826146 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:30.826151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:30.826342 (+ 191us) server_negotiation.cc:407] Connection header received
0807 06:17:30.826499 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:30.826502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:30.826562 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:30.826656 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:30.827411 (+ 755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55346: BlockingRecv error: recv got EOF from 127.0.0.1:55346 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:30.828591 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 31253
I20260807 06:17:30.840296 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 31451
I20260807 06:17:30.854002 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 31639
I20260807 06:17:30.862696 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 31117
2026-08-07T06:17:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2412 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31838](info): set up 2 sockets
Aug 07 06:17:30 dist-test-slave-68xk krb5kdc[31838](info): commencing operation
krb5kdc: starting...
W20260807 06:17:32.100521 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[31838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:32.234258 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35827
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:35827
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:32.346107 31861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:32.346405 31861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:32.346503 31861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:32.350473 31861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:32.350562 31861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:32.350597 31861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:32.350636 31861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:32.350669 31861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:32.355829 31861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:35827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:32.356845 31861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:32.357856 31861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:32.366528 31867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:32.366570 31861 server_base.cc:1034] running on GCE node
W20260807 06:17:32.366642 31872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:32.366564 31868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:32.367344 31861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:32.368360 31861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:32.369529 31861 hybrid_clock.cc:648] HybridClock initialized: now 1786083452369503 us; error 40 us; skew 500 ppm
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[31838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083452, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:32.372432 31861 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:32.373402 31861 webserver.cc:460] Webserver started at http://127.26.252.126:42865/ using document root <none> and password file <none>
I20260807 06:17:32.373970 31861 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:32.374038 31861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:32.374258 31861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:32.376355 31861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1"
format_stamp: "Formatted at 2026-08-07 06:17:32 on dist-test-slave-68xk"
server_key: "594732d0ed6d251011457d520ea58f17"
server_key_iv: "1dc7dc7ad029211cf4f60b4f257915d2"
server_key_version: "encryptionkey@0"
I20260807 06:17:32.376924 31861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1"
format_stamp: "Formatted at 2026-08-07 06:17:32 on dist-test-slave-68xk"
server_key: "594732d0ed6d251011457d520ea58f17"
server_key_iv: "1dc7dc7ad029211cf4f60b4f257915d2"
server_key_version: "encryptionkey@0"
I20260807 06:17:32.380856 31861 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:32.383373 31880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:32.384662 31861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:32.384809 31861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1"
format_stamp: "Formatted at 2026-08-07 06:17:32 on dist-test-slave-68xk"
server_key: "594732d0ed6d251011457d520ea58f17"
server_key_iv: "1dc7dc7ad029211cf4f60b4f257915d2"
server_key_version: "encryptionkey@0"
I20260807 06:17:32.384910 31861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:32.393893 31861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:32.397131 31861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:32.397351 31861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:32.404760 31861 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:35827
I20260807 06:17:32.405133 31949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:35827 every 8 connection(s)
I20260807 06:17:32.405862 31861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:32.408717 31950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:32.411199 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 31861
I20260807 06:17:32.411320 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:32.411635 27633 external_mini_cluster.cc:1428] Setting key 736d18fac7470f3a3b6f5778248fa53d
I20260807 06:17:32.414947 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1: Bootstrap starting.
I20260807 06:17:32.417105 31950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:32.417831 31950 log.cc:824] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:32.420085 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1: No bootstrap required, opened a new log
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[31838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:32.424266 31950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } }
I20260807 06:17:32.424546 31950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:32.424607 31950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8366a59ee64f48cb8b5f4a122d1bf0c1, State: Initialized, Role: FOLLOWER
I20260807 06:17:32.425161 31950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } }
I20260807 06:17:32.425321 31950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:32.425390 31950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:32.425493 31950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:32.426666 31950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } }
I20260807 06:17:32.427031 31950 leader_election.cc:302] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8366a59ee64f48cb8b5f4a122d1bf0c1; no voters:
I20260807 06:17:32.427321 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:32.413015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36658 (local address 127.26.252.126:35827)
0807 06:17:32.413483 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:32.413497 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:32.413532 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:32.414175 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:32.414192 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:32.414596 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:32.414934 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:32.415820 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:32.416778 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:32.417721 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:32.418266 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:32.418452 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:32.421178 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:32.421185 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:32.421208 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:32.421241 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:32.423970 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:32.424434 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:32.424439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:32.424445 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:32.424593 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:32.424901 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:32.424905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:32.424906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:32.425444 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:32.425656 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:32.425944 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 06:17:32.426254 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":137,"threads_started":1}
I20260807 06:17:32.427351 31950 leader_election.cc:288] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:32.427479 31958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:32.427758 31958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8366a59ee64f48cb8b5f4a122d1bf0c1, State: Running, Role: LEADER
I20260807 06:17:32.428085 31958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } }
I20260807 06:17:32.428592 31950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:32.429318 31961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8366a59ee64f48cb8b5f4a122d1bf0c1. Latest consensus state: current_term: 1 leader_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } } }
I20260807 06:17:32.429454 31961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:32.430128 31962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8366a59ee64f48cb8b5f4a122d1bf0c1" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35827 } } }
I20260807 06:17:32.430233 31962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:32.430619 31968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:32.430795 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:17:32.433985 31968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:32.439805 31968 catalog_manager.cc:1347] Generated new cluster ID: b347233da6824273b802758c1e3cfa57
I20260807 06:17:32.439867 31968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:32.454064 31968 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:32.455319 31968 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:32.455480 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:32.450189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.26.252.126:35827)
0807 06:17:32.450322 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:32.450329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:32.450626 (+ 297us) server_negotiation.cc:407] Connection header received
0807 06:17:32.450788 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:32.450791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:32.450845 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:32.450934 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:32.451477 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:32.451982 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:32.452976 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:32.453371 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:32.453480 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:32.454514 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:32.454517 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:32.454520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:32.454986 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:32.455016 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:32.455032 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:32.455148 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:32.455256 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 06:17:32.455336 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:17:32.469645 31968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8366a59ee64f48cb8b5f4a122d1bf0c1: Generated new TSK 0
I20260807 06:17:32.470357 31968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:17:32.477305 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 31861
2026-08-07T06:17:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1614 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[32009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[32009](info): set up 2 sockets
Aug 07 06:17:32 dist-test-slave-68xk krb5kdc[32009](info): commencing operation
krb5kdc: starting...
W20260807 06:17:33.685786 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:33 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:33.813524 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34197
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:33.929818 32027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:33.930114 32027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:33.930208 32027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:33.934234 32027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:33.934322 32027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:33.934362 32027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:33.934399 32027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:33.934461 32027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:33.940604 32027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:33.941779 32027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:33.942951 32027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:33.951674 32041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:33.951974 32027 server_base.cc:1034] running on GCE node
W20260807 06:17:33.951886 32038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:33.951872 32039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:33.952582 32027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:33.953663 32027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:33.954876 32027 hybrid_clock.cc:648] HybridClock initialized: now 1786083453954844 us; error 40 us; skew 500 ppm
Aug 07 06:17:33 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083453, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:33.958065 32027 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:33.959007 32027 webserver.cc:460] Webserver started at http://127.26.252.126:38343/ using document root <none> and password file <none>
I20260807 06:17:33.959609 32027 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:33.959702 32027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:33.959945 32027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:33.962100 32027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "68d56c2b18f648c28b506420b43eb033"
format_stamp: "Formatted at 2026-08-07 06:17:33 on dist-test-slave-68xk"
server_key: "bd3671a4f97611509c189d70f62e2083"
server_key_iv: "557fd84ec08150b9d899088444c20c96"
server_key_version: "encryptionkey@0"
I20260807 06:17:33.962714 32027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "68d56c2b18f648c28b506420b43eb033"
format_stamp: "Formatted at 2026-08-07 06:17:33 on dist-test-slave-68xk"
server_key: "bd3671a4f97611509c189d70f62e2083"
server_key_iv: "557fd84ec08150b9d899088444c20c96"
server_key_version: "encryptionkey@0"
I20260807 06:17:33.966881 32027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:33.969386 32051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:33.970645 32027 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:33.970788 32027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "68d56c2b18f648c28b506420b43eb033"
format_stamp: "Formatted at 2026-08-07 06:17:33 on dist-test-slave-68xk"
server_key: "bd3671a4f97611509c189d70f62e2083"
server_key_iv: "557fd84ec08150b9d899088444c20c96"
server_key_version: "encryptionkey@0"
I20260807 06:17:33.970903 32027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:33.990172 32027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:33.993641 32027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:33.993885 32027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:34.001365 32027 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34197
I20260807 06:17:34.001717 32122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34197 every 8 connection(s)
I20260807 06:17:34.002404 32027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:34.005542 32123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:34.010139 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 32027
I20260807 06:17:34.010299 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:34.010637 27633 external_mini_cluster.cc:1428] Setting key 971c5b8ed35c3b7ab632b75adc040aa9
I20260807 06:17:34.011350 32123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033: Bootstrap starting.
I20260807 06:17:34.013756 32123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:34.014779 32123 log.cc:824] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:34.016981 32123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033: No bootstrap required, opened a new log
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:34.021255 32123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } }
I20260807 06:17:34.021567 32123 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:34.021668 32123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d56c2b18f648c28b506420b43eb033, State: Initialized, Role: FOLLOWER
I20260807 06:17:34.022181 32123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } }
I20260807 06:17:34.022341 32123 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:34.022432 32123 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:34.022534 32123 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:34.023391 32123 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } }
I20260807 06:17:34.023729 32123 leader_election.cc:302] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68d56c2b18f648c28b506420b43eb033; no voters:
I20260807 06:17:34.024078 32123 leader_election.cc:288] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:34.024170 32129 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:34.024345 32129 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [term 1 LEADER]: Becoming Leader. State: Replica: 68d56c2b18f648c28b506420b43eb033, State: Running, Role: LEADER
I20260807 06:17:34.024698 32129 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } }
I20260807 06:17:34.025410 32123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:34.026516 32130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68d56c2b18f648c28b506420b43eb033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } } }
I20260807 06:17:34.026649 32130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:34.026950 32132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68d56c2b18f648c28b506420b43eb033. Latest consensus state: current_term: 1 leader_uuid: "68d56c2b18f648c28b506420b43eb033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d56c2b18f648c28b506420b43eb033" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34197 } } }
I20260807 06:17:34.027070 32145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:34.027139 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.012051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39486 (local address 127.26.252.126:34197)
0807 06:17:34.012497 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:34.012512 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:34.012549 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:17:34.013168 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:34.013185 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:34.013502 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:34.013776 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:34.014788 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.016065 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.017260 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.017761 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.017899 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.020929 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:34.020934 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:34.020947 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:34.020975 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:34.023211 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.023782 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.023789 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.023795 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.023988 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.024314 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.024318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.024320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.024975 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:34.025217 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:34.025578 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 06:17:34.025938 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":152,"threads_started":1}
I20260807 06:17:34.027107 32132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:34.030256 32145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:34.035967 32145 catalog_manager.cc:1347] Generated new cluster ID: f375a650281c4c51995f443396e06ab8
I20260807 06:17:34.036037 32145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:34.048584 32145 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:34.049818 32145 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:34.056951 32145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68d56c2b18f648c28b506420b43eb033: Generated new TSK 0
I20260807 06:17:34.057711 32145 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:34.097906 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:34.212211 32158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:34.212473 32158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:34.212517 32158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:34.216708 32158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:34.216763 32158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:34.216820 32158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:34.221980 32158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:34.223060 32158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:34.224138 32158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:34.234223 32167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:34.234247 32169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:34.234311 32158 server_base.cc:1034] running on GCE node
W20260807 06:17:34.234228 32171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:34.234865 32158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:34.235556 32158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:34.236800 32158 hybrid_clock.cc:648] HybridClock initialized: now 1786083454236784 us; error 30 us; skew 500 ppm
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:34.240131 32158 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:34.241092 32158 webserver.cc:460] Webserver started at http://127.26.252.65:33515/ using document root <none> and password file <none>
I20260807 06:17:34.241732 32158 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:34.241837 32158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:34.242112 32158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:34.244398 32158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "2a2005761d0a4deea7aea137c53b28fe"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "c79bf9117bd70357d63d46c76f002af1"
server_key_iv: "45d442b53727d0e4a1ac9c7e0aca2312"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.245071 32158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "2a2005761d0a4deea7aea137c53b28fe"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "c79bf9117bd70357d63d46c76f002af1"
server_key_iv: "45d442b53727d0e4a1ac9c7e0aca2312"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.249560 32158 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 06:17:34.252277 32180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.253609 32158 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:34.253759 32158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "2a2005761d0a4deea7aea137c53b28fe"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "c79bf9117bd70357d63d46c76f002af1"
server_key_iv: "45d442b53727d0e4a1ac9c7e0aca2312"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.253872 32158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:34.276868 32158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:34.279860 32158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:34.280072 32158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:34.280666 32158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:34.281529 32158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:34.281603 32158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.281674 32158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:34.281718 32158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.290939 32158 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:44543
I20260807 06:17:34.290974 32335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:44543 every 8 connection(s)
I20260807 06:17:34.291821 32158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:34.294730 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 32158
I20260807 06:17:34.294865 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:34.295240 27633 external_mini_cluster.cc:1428] Setting key edb1d33b51fd297dfc176ced452a00db
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:34.307731 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.293626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:47331 (local address 127.26.252.126:34197)
0807 06:17:34.293774 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:34.293778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:34.294684 (+ 906us) server_negotiation.cc:407] Connection header received
0807 06:17:34.296434 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:34.296438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:34.296492 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:34.296599 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:34.298176 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.298749 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.299980 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.300400 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.300526 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.303497 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:34.303504 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:34.303511 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:34.303548 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:34.305400 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.305978 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.305984 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.305989 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.306098 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.306510 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.306515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.306517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.306774 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:34.306880 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:34.307493 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 06:17:34.307605 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:17:34.308614 32340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.293995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34197 (local address 127.26.252.65:47331)
0807 06:17:34.294495 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:34.294557 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:34.296229 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:34.296799 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:34.296808 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:34.297308 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:34.298007 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.298029 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.298892 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.298899 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.299852 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.299862 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.300560 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.300563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.300714 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.301347 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:34.301364 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:34.303311 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:34.305525 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.305530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.305542 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.305850 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.306215 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.306218 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.306219 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.306359 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.306894 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:34.306899 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:34.307223 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 06:17:34.307413 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 06:17:34.307745 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:34.310159 32337 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34197
I20260807 06:17:34.310462 32337 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:34.311080 32337 heartbeater.cc:511] Master 127.26.252.126:34197 requested a full tablet report, sending...
I20260807 06:17:34.312979 32075 ts_manager.cc:194] Registered new tserver with Master: 2a2005761d0a4deea7aea137c53b28fe (127.26.252.65:44543)
I20260807 06:17:34.314723 32075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:47331
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:34.329062 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:34.448223 32343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:34.448508 32343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:34.448555 32343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:34.452589 32343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:34.452641 32343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:34.452737 32343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:34.458335 32343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:34.459398 32343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:34.460419 32343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:34.470052 32351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:34.470080 32353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:34.470170 32349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:34.470223 32343 server_base.cc:1034] running on GCE node
I20260807 06:17:34.470784 32343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:34.471411 32343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:34.472599 32343 hybrid_clock.cc:648] HybridClock initialized: now 1786083454472594 us; error 41 us; skew 500 ppm
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:34.475725 32343 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:34.476616 32343 webserver.cc:460] Webserver started at http://127.26.252.66:39531/ using document root <none> and password file <none>
I20260807 06:17:34.477128 32343 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:34.477198 32343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:34.477366 32343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:34.479410 32343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "bf8427b8e9384324b5c3de69894ac720"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "38fcebcdffcbec8eb32918c65127b186"
server_key_iv: "33f4cbd0ad7249e5ca96ead985a421c1"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.479925 32343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "bf8427b8e9384324b5c3de69894ac720"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "38fcebcdffcbec8eb32918c65127b186"
server_key_iv: "33f4cbd0ad7249e5ca96ead985a421c1"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.483561 32343 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 06:17:34.485895 32365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.487200 32343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:34.487298 32343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "bf8427b8e9384324b5c3de69894ac720"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "38fcebcdffcbec8eb32918c65127b186"
server_key_iv: "33f4cbd0ad7249e5ca96ead985a421c1"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.487380 32343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:34.513414 32343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:34.516429 32343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:34.516585 32343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:34.517139 32343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:34.517935 32343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:34.517992 32343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.518033 32343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:34.518049 32343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.527848 32343 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:36149
I20260807 06:17:34.527920 32540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:36149 every 8 connection(s)
I20260807 06:17:34.528795 32343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:34.536629 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 32343
I20260807 06:17:34.536770 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:34.537050 27633 external_mini_cluster.cc:1428] Setting key 12d6c1e7d5e1c6a4990332ec7b0d9bac
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:34.544762 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.530701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57509 (local address 127.26.252.126:34197)
0807 06:17:34.530857 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:34.530863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:34.531725 (+ 862us) server_negotiation.cc:407] Connection header received
0807 06:17:34.533188 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:34.533192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:34.533241 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:34.533319 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:34.534735 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.535284 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.536681 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.537028 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.537174 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.540170 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:34.540174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:34.540177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:34.540215 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:34.542114 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.542888 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.542891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.542893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.542978 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.543439 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.543441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.543442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.543623 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:34.543710 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:34.544517 (+ 807us) server_negotiation.cc:299] Negotiation successful
0807 06:17:34.544633 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:17:34.546218 32543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.531064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34197 (local address 127.26.252.66:57509)
0807 06:17:34.531562 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:34.531608 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:34.532976 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:34.533525 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:34.533532 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:34.533953 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:34.534584 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.534603 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.535442 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.535445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.536512 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.536524 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.537227 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.537232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.537456 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.538201 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:34.538220 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:34.539968 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:34.542237 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.542247 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.542270 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.542763 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.543093 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.543100 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.543105 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.543326 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.543737 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:34.543748 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:34.544189 (+ 441us) client_negotiation.cc:769] Sending connection context
0807 06:17:34.544436 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 06:17:34.544871 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":126,"threads_started":1}
I20260807 06:17:34.547636 32541 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34197
I20260807 06:17:34.547961 32541 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:34.548671 32541 heartbeater.cc:511] Master 127.26.252.126:34197 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:34.550102 32075 ts_manager.cc:194] Registered new tserver with Master: bf8427b8e9384324b5c3de69894ac720 (127.26.252.66:36149)
I20260807 06:17:34.550945 32075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:57509
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:34.570592 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:34.684089 32547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:34.684347 32547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:34.684391 32547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:34.688468 32547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:34.688529 32547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:34.688586 32547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:34.693979 32547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:34.695161 32547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:34.696236 32547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:34.706135 32558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:34.706173 32560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:34.706161 32556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:34.706238 32547 server_base.cc:1034] running on GCE node
I20260807 06:17:34.706986 32547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:34.707621 32547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:34.708813 32547 hybrid_clock.cc:648] HybridClock initialized: now 1786083454708803 us; error 34 us; skew 500 ppm
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:34.711671 32547 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:34.712558 32547 webserver.cc:460] Webserver started at http://127.26.252.67:41323/ using document root <none> and password file <none>
I20260807 06:17:34.713155 32547 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:34.713251 32547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:34.713491 32547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:34.715588 32547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "5743542c5c694310b7824c4e1ad5a959"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "a5e09fa04096ed60cc71c3b5407cb174"
server_key_iv: "32dedeebb2e902c711e9760494dd0aef"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.716181 32547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "5743542c5c694310b7824c4e1ad5a959"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "a5e09fa04096ed60cc71c3b5407cb174"
server_key_iv: "32dedeebb2e902c711e9760494dd0aef"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.719969 32547 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:17:34.722482 32574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.723749 32547 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:34.723986 32547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "5743542c5c694310b7824c4e1ad5a959"
format_stamp: "Formatted at 2026-08-07 06:17:34 on dist-test-slave-68xk"
server_key: "a5e09fa04096ed60cc71c3b5407cb174"
server_key_iv: "32dedeebb2e902c711e9760494dd0aef"
server_key_version: "encryptionkey@0"
I20260807 06:17:34.724100 32547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:34.743548 32547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:34.746870 32547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:34.747087 32547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:34.747718 32547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:34.748597 32547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:34.748672 32547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.748742 32547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:34.748790 32547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:34.758497 32547 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:35135
I20260807 06:17:34.758627 32730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:35135 every 8 connection(s)
I20260807 06:17:34.759465 32547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:34.768332 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 32547
I20260807 06:17:34.768440 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:34.768733 27633 external_mini_cluster.cc:1428] Setting key 8fcab58a6abcc74ae65be99f6a569b5e
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:34.773785 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.761330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:36349 (local address 127.26.252.126:34197)
0807 06:17:34.761480 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:34.761483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:34.762329 (+ 846us) server_negotiation.cc:407] Connection header received
0807 06:17:34.763898 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:34.763902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:34.763965 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:34.764073 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:34.765272 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.765813 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.767064 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.767303 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.767415 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.770162 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:34.770165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:34.770170 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:34.770200 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:34.771714 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.772230 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.772235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.772237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.772321 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.772666 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.772669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.772671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.772848 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:34.772959 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:34.773481 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 06:17:34.773605 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:17:34.774673 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.761702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34197 (local address 127.26.252.67:36349)
0807 06:17:34.762177 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:34.762220 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:34.763677 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:34.764250 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:34.764258 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:34.764615 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:34.765115 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.765130 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.765944 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.765971 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.766935 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:34.766945 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.767459 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.767463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:34.767640 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.768287 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:34.768304 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:34.770000 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:34.771844 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.771850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.771864 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.772121 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.772416 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:34.772419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:34.772421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:34.772565 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:34.772959 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:34.772967 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:34.773218 (+ 251us) client_negotiation.cc:769] Sending connection context
0807 06:17:34.773402 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 06:17:34.773728 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":124,"threads_started":1}
I20260807 06:17:34.775795 32731 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34197
I20260807 06:17:34.776147 32731 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:34.776676 32731 heartbeater.cc:511] Master 127.26.252.126:34197 requested a full tablet report, sending...
I20260807 06:17:34.777688 32075 ts_manager.cc:194] Registered new tserver with Master: 5743542c5c694310b7824c4e1ad5a959 (127.26.252.67:35135)
I20260807 06:17:34.778260 32075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:36349
I20260807 06:17:34.782955 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083454, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:34.811596 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:34.802643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39488 (local address 127.26.252.126:34197)
0807 06:17:34.802788 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:34.802792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:34.802989 (+ 197us) server_negotiation.cc:407] Connection header received
0807 06:17:34.803145 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:34.803148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:34.803193 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:34.803271 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:34.804074 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.804600 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.805542 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:34.805768 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:34.805863 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:34.808417 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:34.808420 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:34.808422 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:34.808448 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:34.809935 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.810351 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.810353 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.810354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.810530 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:34.810798 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:34.810800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:34.810801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:34.811021 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:34.811123 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:34.811370 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 06:17:34.811472 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 06:17:34.812016 32075 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39488
I20260807 06:17:34.813010 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 32158
I20260807 06:17:34.825837 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 32343
I20260807 06:17:34.838466 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 32547
I20260807 06:17:34.850090 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 32027
2026-08-07T06:17:34Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2372 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32751](info): set up 2 sockets
Aug 07 06:17:34 dist-test-slave-68xk krb5kdc[32751](info): commencing operation
krb5kdc: starting...
W20260807 06:17:36.128940 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:36.265664 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34643
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34643
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:36.384079 305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:36.384407 305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:36.384492 305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:36.388545 305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:36.388641 305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:36.388679 305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:36.388720 305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:36.388759 305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:36.394002 305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:36.395176 305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:36.396235 305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:36.405032 312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:36.405203 305 server_base.cc:1034] running on GCE node
W20260807 06:17:36.405022 311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:36.405026 316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:36.405961 305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:36.407172 305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:36.408365 305 hybrid_clock.cc:648] HybridClock initialized: now 1786083456408334 us; error 48 us; skew 500 ppm
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:36.415989 305 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:36.416929 305 webserver.cc:460] Webserver started at http://127.26.252.126:46507/ using document root <none> and password file <none>
I20260807 06:17:36.417522 305 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:36.417618 305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:36.417861 305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:36.420032 305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "fae7ae45263e4109a63bbeefccf69d9f"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "93affcf3b5d7bb72388c9f20e9bcb8d5"
server_key_iv: "e27b5ad07984ec506e04306903e7ceb6"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.420614 305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "fae7ae45263e4109a63bbeefccf69d9f"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "93affcf3b5d7bb72388c9f20e9bcb8d5"
server_key_iv: "e27b5ad07984ec506e04306903e7ceb6"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.424399 305 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:17:36.426925 327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.428184 305 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:36.428390 305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "fae7ae45263e4109a63bbeefccf69d9f"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "93affcf3b5d7bb72388c9f20e9bcb8d5"
server_key_iv: "e27b5ad07984ec506e04306903e7ceb6"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.428507 305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:36.447878 305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:36.451180 305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:36.451406 305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:36.458602 305 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34643
I20260807 06:17:36.458649 396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34643 every 8 connection(s)
I20260807 06:17:36.459530 305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:36.462441 397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:36.463142 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 305
I20260807 06:17:36.463285 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:36.463640 27633 external_mini_cluster.cc:1428] Setting key b985d6d99ffd915812a6b50ac39692ff
I20260807 06:17:36.469717 397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f: Bootstrap starting.
I20260807 06:17:36.472208 397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f: Neither blocks nor log segments found. Creating new log.
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:36.473232 397 log.cc:824] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:36.475431 397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f: No bootstrap required, opened a new log
I20260807 06:17:36.478200 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:36.465182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39192 (local address 127.26.252.126:34643)
0807 06:17:36.465648 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:36.465662 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:36.465697 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:36.466356 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:36.466371 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:36.466758 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:36.467084 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:36.467915 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.468878 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.469764 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.470263 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.470458 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:36.473429 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:36.473434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:36.473447 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:36.473473 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:36.475337 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.475873 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.475878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.475882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.475992 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.476321 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.476323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.476324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.476677 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:36.476909 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:36.477202 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 06:17:36.477500 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":146,"threads_started":1}
I20260807 06:17:36.479954 397 raft_consensus.cc:348] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } }
I20260807 06:17:36.480237 397 raft_consensus.cc:374] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:36.480309 397 raft_consensus.cc:729] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fae7ae45263e4109a63bbeefccf69d9f, State: Initialized, Role: FOLLOWER
I20260807 06:17:36.480786 397 consensus_queue.cc:260] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } }
I20260807 06:17:36.480924 397 raft_consensus.cc:388] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:36.481022 397 raft_consensus.cc:482] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:36.481160 397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:36.482234 397 raft_consensus.cc:504] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } }
I20260807 06:17:36.482651 397 leader_election.cc:302] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fae7ae45263e4109a63bbeefccf69d9f; no voters:
I20260807 06:17:36.482978 397 leader_election.cc:288] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:36.483103 404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:36.483371 404 raft_consensus.cc:686] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [term 1 LEADER]: Becoming Leader. State: Replica: fae7ae45263e4109a63bbeefccf69d9f, State: Running, Role: LEADER
I20260807 06:17:36.483740 404 consensus_queue.cc:237] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } }
I20260807 06:17:36.484308 397 sys_catalog.cc:564] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:36.485414 405 sys_catalog.cc:455] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fae7ae45263e4109a63bbeefccf69d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } } }
I20260807 06:17:36.485551 405 sys_catalog.cc:458] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:36.485894 406 sys_catalog.cc:455] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fae7ae45263e4109a63bbeefccf69d9f. Latest consensus state: current_term: 1 leader_uuid: "fae7ae45263e4109a63bbeefccf69d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fae7ae45263e4109a63bbeefccf69d9f" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34643 } } }
I20260807 06:17:36.485970 418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:36.486096 406 sys_catalog.cc:458] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:36.488849 418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:36.494668 418 catalog_manager.cc:1347] Generated new cluster ID: 42f31da95edf4f9abeeda86e250ecbe9
I20260807 06:17:36.494735 418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:36.504840 418 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:36.506165 418 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:36.517086 418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fae7ae45263e4109a63bbeefccf69d9f: Generated new TSK 0
I20260807 06:17:36.517953 418 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:36.554162 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:36.675027 436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:36.675319 436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:36.675403 436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:36.680068 436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:36.680131 436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:36.680238 436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:36.686484 436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:36.687664 436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:36.688838 436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:36.699090 442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:36.699118 443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:36.699160 446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:36.699330 436 server_base.cc:1034] running on GCE node
I20260807 06:17:36.699783 436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:36.700449 436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:36.701619 436 hybrid_clock.cc:648] HybridClock initialized: now 1786083456701582 us; error 47 us; skew 500 ppm
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:36.704658 436 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:36.705607 436 webserver.cc:460] Webserver started at http://127.26.252.65:44423/ using document root <none> and password file <none>
I20260807 06:17:36.706183 436 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:36.706302 436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:36.706578 436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:36.708658 436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "547218ced7b442369dc2145f493ad7a9"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "91b8169e9f6ffbe5a7d523187576932e"
server_key_iv: "1614d4067376f89634cf473fc9dfe064"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.709235 436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "547218ced7b442369dc2145f493ad7a9"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "91b8169e9f6ffbe5a7d523187576932e"
server_key_iv: "1614d4067376f89634cf473fc9dfe064"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.713513 436 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:17:36.716163 456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.717461 436 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:36.717592 436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "547218ced7b442369dc2145f493ad7a9"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "91b8169e9f6ffbe5a7d523187576932e"
server_key_iv: "1614d4067376f89634cf473fc9dfe064"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.717705 436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:36.732815 436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:36.735920 436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:36.736141 436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:36.736768 436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:36.737612 436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:36.737661 436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.737702 436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:36.737720 436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.747712 436 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:33601
I20260807 06:17:36.747747 629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:33601 every 8 connection(s)
I20260807 06:17:36.748672 436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:36.751828 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 436
I20260807 06:17:36.751964 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:36.752313 27633 external_mini_cluster.cc:1428] Setting key bb923cb4b545d1cf8dff09325f5cb904
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:36.765242 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:36.750615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:43191 (local address 127.26.252.126:34643)
0807 06:17:36.750790 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:36.750795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:36.751825 (+ 1030us) server_negotiation.cc:407] Connection header received
0807 06:17:36.753597 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:36.753600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:36.753646 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:36.753755 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:36.755130 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.755978 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.757853 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.758093 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.758179 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:36.761290 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:36.761294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:36.761296 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:36.761321 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:36.762903 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.763498 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.763501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.763502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.763581 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.763946 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.763950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.763951 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.764142 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:36.764255 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:36.764901 (+ 646us) server_negotiation.cc:299] Negotiation successful
0807 06:17:36.765041 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:17:36.766152 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:36.751091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34643 (local address 127.26.252.65:43191)
0807 06:17:36.751616 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:36.751682 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:36.753370 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:36.753987 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:36.753997 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:36.754454 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:36.754966 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:36.754980 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.756137 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.756143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:36.757691 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:36.757707 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.758273 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.758279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:36.758556 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:36.759239 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:36.759267 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:36.761087 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:36.763032 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:36.763038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:36.763054 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:36.763327 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:36.763680 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:36.763684 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:36.763686 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:36.763835 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:36.764256 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:36.764263 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:36.764640 (+ 377us) client_negotiation.cc:769] Sending connection context
0807 06:17:36.764842 (+ 202us) client_negotiation.cc:240] Negotiation successful
0807 06:17:36.765201 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:36.767524 630 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34643
I20260807 06:17:36.767800 630 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:36.768330 630 heartbeater.cc:511] Master 127.26.252.126:34643 requested a full tablet report, sending...
I20260807 06:17:36.770009 348 ts_manager.cc:194] Registered new tserver with Master: 547218ced7b442369dc2145f493ad7a9 (127.26.252.65:33601)
I20260807 06:17:36.771798 348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:43191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:36.785374 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:36.901194 640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:36.901469 640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:36.901513 640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:36.905607 640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:36.905674 640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:36.905732 640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:36.911090 640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:36.912173 640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:36.913244 640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:36.923128 646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:36.923151 650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:36.923213 640 server_base.cc:1034] running on GCE node
W20260807 06:17:36.923151 645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:36.923833 640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:36.924503 640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:36.925674 640 hybrid_clock.cc:648] HybridClock initialized: now 1786083456925653 us; error 32 us; skew 500 ppm
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:36.928694 640 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:36.929565 640 webserver.cc:460] Webserver started at http://127.26.252.66:37187/ using document root <none> and password file <none>
I20260807 06:17:36.930156 640 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:36.930290 640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:36.930585 640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:36.932936 640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "6e0a42dc508041f685cb63642f426b65"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "be3970997a09ae1c2dbc355da73af422"
server_key_iv: "d074e01e098231941f113ad877797016"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.933532 640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "6e0a42dc508041f685cb63642f426b65"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "be3970997a09ae1c2dbc355da73af422"
server_key_iv: "d074e01e098231941f113ad877797016"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.937322 640 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 06:17:36.939999 658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.941361 640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:17:36.941468 640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "6e0a42dc508041f685cb63642f426b65"
format_stamp: "Formatted at 2026-08-07 06:17:36 on dist-test-slave-68xk"
server_key: "be3970997a09ae1c2dbc355da73af422"
server_key_iv: "d074e01e098231941f113ad877797016"
server_key_version: "encryptionkey@0"
I20260807 06:17:36.941553 640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:36.962054 640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:36.965791 640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:36.966001 640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:36.966730 640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:36.967638 640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:36.967691 640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.967737 640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:36.967767 640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:36.977737 640 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:42577
I20260807 06:17:36.977811 815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:42577 every 8 connection(s)
I20260807 06:17:36.978796 640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:36.982762 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 640
I20260807 06:17:36.982872 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:36.983189 27633 external_mini_cluster.cc:1428] Setting key 94135ab35023843607961f778d10de08
Aug 07 06:17:36 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083456, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:36.994288 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:36.980746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:46679 (local address 127.26.252.126:34643)
0807 06:17:36.980901 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:36.980905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:36.981796 (+ 891us) server_negotiation.cc:407] Connection header received
0807 06:17:36.983432 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:36.983436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:36.983498 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:36.983609 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:36.985244 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.986086 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.987429 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.987673 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.987817 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:36.990462 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:36.990468 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:36.990473 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:36.990509 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:36.992020 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.992560 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.992565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.992567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.992657 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:36.993028 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:36.993032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:36.993034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:36.993236 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:36.993356 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:36.993973 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 06:17:36.994155 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:17:36.995208 818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:36.981166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34643 (local address 127.26.252.66:46679)
0807 06:17:36.981631 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:36.981675 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:36.983157 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:36.983791 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:36.983798 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:36.984326 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:36.984959 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:36.984980 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.986249 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.986252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:36.987296 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:36.987306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:36.987858 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:36.987862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:36.988034 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:36.988700 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:36.988718 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:36.990260 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:36.992148 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:36.992155 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:36.992171 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:36.992452 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:36.992755 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:36.992765 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:36.992768 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:36.992926 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:36.993356 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:36.993364 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:36.993627 (+ 263us) client_negotiation.cc:769] Sending connection context
0807 06:17:36.993848 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 06:17:36.994135 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":116,"threads_started":1}
I20260807 06:17:36.996589 816 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34643
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:17:36.996881 816 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:36.997509 816 heartbeater.cc:511] Master 127.26.252.126:34643 requested a full tablet report, sending...
I20260807 06:17:36.998768 348 ts_manager.cc:194] Registered new tserver with Master: 6e0a42dc508041f685cb63642f426b65 (127.26.252.66:42577)
I20260807 06:17:36.999769 348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:46679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:37.015702 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:37.141387 822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:37.141680 822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:37.141754 822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:37.146528 822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:37.146589 822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:37.146714 822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:37.152609 822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:37.153663 822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:37.154768 822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:37.165261 827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:37.165210 830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:37.165283 822 server_base.cc:1034] running on GCE node
W20260807 06:17:37.165200 828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:37.165910 822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:37.166673 822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:37.167909 822 hybrid_clock.cc:648] HybridClock initialized: now 1786083457167869 us; error 53 us; skew 500 ppm
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083457, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:37.171159 822 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:37.172338 822 webserver.cc:460] Webserver started at http://127.26.252.67:35627/ using document root <none> and password file <none>
I20260807 06:17:37.172962 822 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:37.173066 822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:37.173300 822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:37.175566 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "b3ebea889139408cbedc9857c83e55c3"
format_stamp: "Formatted at 2026-08-07 06:17:37 on dist-test-slave-68xk"
server_key: "ad9174204d156bca90a0c972faa68243"
server_key_iv: "e2ce7c8fc97fdf81c5e40a50fa46da48"
server_key_version: "encryptionkey@0"
I20260807 06:17:37.176218 822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "b3ebea889139408cbedc9857c83e55c3"
format_stamp: "Formatted at 2026-08-07 06:17:37 on dist-test-slave-68xk"
server_key: "ad9174204d156bca90a0c972faa68243"
server_key_iv: "e2ce7c8fc97fdf81c5e40a50fa46da48"
server_key_version: "encryptionkey@0"
I20260807 06:17:37.180394 822 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:37.183205 845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:37.184446 822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:37.184604 822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "b3ebea889139408cbedc9857c83e55c3"
format_stamp: "Formatted at 2026-08-07 06:17:37 on dist-test-slave-68xk"
server_key: "ad9174204d156bca90a0c972faa68243"
server_key_iv: "e2ce7c8fc97fdf81c5e40a50fa46da48"
server_key_version: "encryptionkey@0"
I20260807 06:17:37.184752 822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:37.209348 822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:37.212664 822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:37.212877 822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:37.213522 822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:37.214390 822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:37.214507 822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:37.214581 822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:37.214623 822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:37.224452 822 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:40851
I20260807 06:17:37.224486 1002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:40851 every 8 connection(s)
I20260807 06:17:37.225446 822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:37.234225 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 822
I20260807 06:17:37.234403 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:37.234829 27633 external_mini_cluster.cc:1428] Setting key 87bb5e0a673f41e0ba8ae358d08ca869
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083457, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:37.240877 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:37.227553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:49515 (local address 127.26.252.126:34643)
0807 06:17:37.227717 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:37.227720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:37.228598 (+ 878us) server_negotiation.cc:407] Connection header received
0807 06:17:37.230125 (+ 1527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:37.230129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:37.230179 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:37.230261 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:37.231576 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.232285 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.233503 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.233763 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.233862 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:37.236808 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:37.236812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:37.236814 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:37.236841 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:37.238858 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.239415 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.239418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.239420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.239506 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.239816 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.239818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.239819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.240003 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:37.240127 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:37.240621 (+ 494us) server_negotiation.cc:299] Negotiation successful
0807 06:17:37.240734 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:37.241685 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:37.227970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34643 (local address 127.26.252.67:49515)
0807 06:17:37.228430 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:37.228474 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:37.229902 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:37.230476 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:37.230486 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:37.230883 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:37.231433 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:37.231447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.232404 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.232407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:37.233396 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:37.233406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.233945 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.233949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:37.234128 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:37.234831 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:37.234848 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:37.236592 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:37.238980 (+ 2388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:37.238985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:37.238997 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:37.239311 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:37.239591 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:37.239593 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:37.239595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:37.239730 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:37.240096 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:37.240100 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:37.240366 (+ 266us) client_negotiation.cc:769] Sending connection context
0807 06:17:37.240526 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 06:17:37.240798 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":114,"threads_started":1}
I20260807 06:17:37.243022 1003 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34643
I20260807 06:17:37.243366 1003 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:37.243997 1003 heartbeater.cc:511] Master 127.26.252.126:34643 requested a full tablet report, sending...
I20260807 06:17:37.245199 348 ts_manager.cc:194] Registered new tserver with Master: b3ebea889139408cbedc9857c83e55c3 (127.26.252.67:40851)
I20260807 06:17:37.245810 348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:49515
I20260807 06:17:37.249873 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[32751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:37.279296 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:37.268615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56474 (local address 127.26.252.65:33601)
0807 06:17:37.268968 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:37.268975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:37.269009 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:17:37.269080 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:37.269085 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:37.269284 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:37.269421 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:37.270203 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.271218 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.272177 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.272590 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.272716 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:37.275460 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:37.275470 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:37.275484 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:37.275508 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:37.277337 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.277801 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.277806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.277807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.277898 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.278218 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.278221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.278222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.278572 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:37.278747 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:37.278980 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 06:17:37.279154 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":119,"threads_started":1}
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[32751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:37.290772 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:37.282388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39202 (local address 127.26.252.126:34643)
0807 06:17:37.282582 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:37.282586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:37.282600 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:17:37.282696 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:37.282698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:37.282740 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:37.282809 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:37.283425 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.284029 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.284800 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:37.285123 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:37.285216 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:37.287595 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:37.287598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:37.287600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:37.287625 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:37.289082 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.289444 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.289446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.289447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.289523 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:37.289825 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:37.289830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:37.289832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:37.290048 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:37.290194 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:37.290489 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 06:17:37.290613 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260807 06:17:37.291239 348 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39202
I20260807 06:17:37.291831 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 436
I20260807 06:17:37.306623 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 640
I20260807 06:17:37.323614 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 822
I20260807 06:17:37.337235 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 305
2026-08-07T06:17:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2488 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[1019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[1019](info): set up 2 sockets
Aug 07 06:17:37 dist-test-slave-68xk krb5kdc[1019](info): commencing operation
krb5kdc: starting...
W20260807 06:17:38.556795 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:38 dist-test-slave-68xk krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:38.689914 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:33905
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:33905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:38.824209 1040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:38.824473 1040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:38.824515 1040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:38.828531 1040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:38.828583 1040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:38.828603 1040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:38.828619 1040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:38.828634 1040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:38.833791 1040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:33905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:33905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:38.834841 1040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:38.835913 1040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:38.845850 1055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:38.845912 1047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:38.845845 1045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:38.846092 1040 server_base.cc:1034] running on GCE node
I20260807 06:17:38.846800 1040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:38.847940 1040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:38.849170 1040 hybrid_clock.cc:648] HybridClock initialized: now 1786083458849156 us; error 42 us; skew 500 ppm
Aug 07 06:17:38 dist-test-slave-68xk krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:38.852057 1040 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:38.852883 1040 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:38.852950 1040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:38.853216 1040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:38.855377 1040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "58281000f9984cd393692a263d3c50ee"
format_stamp: "Formatted at 2026-08-07 06:17:38 on dist-test-slave-68xk"
server_key: "82ac5e4f5762d56057bac9ed9b8e52bc"
server_key_iv: "39201946fc8a4e7b1b5cc2479c74302b"
server_key_version: "encryptionkey@0"
I20260807 06:17:38.855949 1040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "58281000f9984cd393692a263d3c50ee"
format_stamp: "Formatted at 2026-08-07 06:17:38 on dist-test-slave-68xk"
server_key: "82ac5e4f5762d56057bac9ed9b8e52bc"
server_key_iv: "39201946fc8a4e7b1b5cc2479c74302b"
server_key_version: "encryptionkey@0"
I20260807 06:17:38.859669 1040 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:17:38.862139 1061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:38.863584 1040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:38.863761 1040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "58281000f9984cd393692a263d3c50ee"
format_stamp: "Formatted at 2026-08-07 06:17:38 on dist-test-slave-68xk"
server_key: "82ac5e4f5762d56057bac9ed9b8e52bc"
server_key_iv: "39201946fc8a4e7b1b5cc2479c74302b"
server_key_version: "encryptionkey@0"
I20260807 06:17:38.863879 1040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:38.884217 1040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:38.887578 1040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:38.887796 1040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:38.895242 1040 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:33905
I20260807 06:17:38.895529 1134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:33905 every 8 connection(s)
I20260807 06:17:38.895956 1040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:38.897152 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1040
I20260807 06:17:38.897280 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:38.897600 27633 external_mini_cluster.cc:1428] Setting key a88674657d48ff4a7d90e3c7b1a47896
I20260807 06:17:38.899457 1135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:38.906236 1135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: Bootstrap starting.
Aug 07 06:17:38 dist-test-slave-68xk krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:38.908665 1135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:38.909435 1135 log.cc:824] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:38.911815 1135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: No bootstrap required, opened a new log
I20260807 06:17:38.913215 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:38.899053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41074 (local address 127.26.252.126:33905)
0807 06:17:38.899538 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:38.899577 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:38.899631 (+ 54us) server_negotiation.cc:407] Connection header received
0807 06:17:38.900298 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:38.900314 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:38.900630 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:38.900917 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:38.901851 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:38.902956 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:38.904194 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:38.904699 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:38.904828 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:38.908061 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:38.908067 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:38.908080 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:38.908108 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:38.910166 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:38.910759 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:38.910765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:38.910769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:38.910882 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:38.911239 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:38.911243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:38.911244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:38.911663 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:38.911820 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:38.912169 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:17:38.912486 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":158,"threads_started":1}
I20260807 06:17:38.915539 1135 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } }
I20260807 06:17:38.915787 1135 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:38.915870 1135 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58281000f9984cd393692a263d3c50ee, State: Initialized, Role: FOLLOWER
I20260807 06:17:38.916299 1135 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } }
I20260807 06:17:38.916461 1135 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:38.916549 1135 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:38.916677 1135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:38.917594 1135 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } }
I20260807 06:17:38.917938 1135 leader_election.cc:302] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58281000f9984cd393692a263d3c50ee; no voters:
I20260807 06:17:38.918280 1135 leader_election.cc:288] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:38.918413 1147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:38.918749 1147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [term 1 LEADER]: Becoming Leader. State: Replica: 58281000f9984cd393692a263d3c50ee, State: Running, Role: LEADER
I20260807 06:17:38.919098 1147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } }
I20260807 06:17:38.919608 1135 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:38.920930 1149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58281000f9984cd393692a263d3c50ee. Latest consensus state: current_term: 1 leader_uuid: "58281000f9984cd393692a263d3c50ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } } }
I20260807 06:17:38.921078 1149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:38.921528 1159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:38.921497 1148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58281000f9984cd393692a263d3c50ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58281000f9984cd393692a263d3c50ee" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33905 } } }
I20260807 06:17:38.921638 1148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:38.925261 1159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:38.930733 1159 catalog_manager.cc:1347] Generated new cluster ID: 34791260d1d7405e8b45f1678845e651
I20260807 06:17:38.930799 1159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:38.947935 1159 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:38.949018 1159 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:38.965584 1159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: Generated new TSK 0
I20260807 06:17:38.966370 1159 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:39.002000 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:39.120560 1178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:39.120800 1178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:39.120842 1178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:39.124919 1178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:39.124976 1178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:39.125036 1178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:39.130208 1178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:39.131227 1178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:39.132233 1178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:39.141680 1183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.141779 1186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.141861 1188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:39.142092 1178 server_base.cc:1034] running on GCE node
I20260807 06:17:39.142583 1178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:39.143168 1178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:39.144327 1178 hybrid_clock.cc:648] HybridClock initialized: now 1786083459144310 us; error 32 us; skew 500 ppm
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:39.147460 1178 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:39.148434 1178 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:39.148540 1178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:39.148789 1178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:39.151154 1178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "88182e6bd6a24bb2aeebf801c24b9bc6"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "f2660d6cbe35ab92d342b506b3e10063"
server_key_iv: "03920cadbc90a04ae0e8d1e2a1c9633f"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.151786 1178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "88182e6bd6a24bb2aeebf801c24b9bc6"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "f2660d6cbe35ab92d342b506b3e10063"
server_key_iv: "03920cadbc90a04ae0e8d1e2a1c9633f"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.155740 1178 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:17:39.158300 1195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.159582 1178 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:39.159744 1178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "88182e6bd6a24bb2aeebf801c24b9bc6"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "f2660d6cbe35ab92d342b506b3e10063"
server_key_iv: "03920cadbc90a04ae0e8d1e2a1c9633f"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.159864 1178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:39.178656 1178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:39.181988 1178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:39.182212 1178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:39.182898 1178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:39.183765 1178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:39.183851 1178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.183943 1178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:39.183995 1178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.193141 1178 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:46877
I20260807 06:17:39.193161 1356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:46877 every 8 connection(s)
I20260807 06:17:39.193754 1178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:39.200569 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1178
I20260807 06:17:39.200727 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:39.201041 27633 external_mini_cluster.cc:1428] Setting key d84c2746941f81b8f9689f2c99cb2a49
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:39.209157 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.195717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:52267 (local address 127.26.252.126:33905)
0807 06:17:39.195899 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.195903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.196738 (+ 835us) server_negotiation.cc:407] Connection header received
0807 06:17:39.198338 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.198341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.198391 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.198553 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:39.199785 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.200407 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.201862 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.202177 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.202293 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.205228 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:39.205235 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:39.205240 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:39.205278 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:39.206909 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.207427 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.207434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.207436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.207525 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.207894 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.207898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.207901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.208091 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:39.208208 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.208834 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.208978 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 06:17:39.210047 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.196056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:33905 (local address 127.26.252.65:52267)
0807 06:17:39.196561 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.196606 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.197939 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.198734 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.198741 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.199105 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:39.199613 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.199627 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.200555 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.200563 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.201652 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.201663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.202358 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.202364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.202605 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.203265 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:39.203281 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:39.205030 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:39.207019 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.207023 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.207037 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.207307 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.207627 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.207631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.207633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.207781 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.208205 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:39.208252 (+ 47us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:39.208567 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.208793 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.209125 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":127,"threads_started":1}
I20260807 06:17:39.211519 1359 heartbeater.cc:347] Connected to a master server at 127.26.252.126:33905
I20260807 06:17:39.211776 1359 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:39.212276 1359 heartbeater.cc:511] Master 127.26.252.126:33905 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:39.213860 1087 ts_manager.cc:194] Registered new tserver with Master: 88182e6bd6a24bb2aeebf801c24b9bc6 (127.26.252.65:46877)
I20260807 06:17:39.215013 1087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:52267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:39.233582 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:39.344811 1365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:39.345060 1365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:39.345105 1365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:39.349081 1365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:39.349138 1365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:39.349196 1365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:39.354224 1365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:39.355212 1365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:39.356150 1365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:17:39.365785 1365 server_base.cc:1034] running on GCE node
W20260807 06:17:39.365648 1376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.365644 1375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.365670 1380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:39.366384 1365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:39.367062 1365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:39.368252 1365 hybrid_clock.cc:648] HybridClock initialized: now 1786083459368238 us; error 30 us; skew 500 ppm
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:39.371268 1365 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:39.372061 1365 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:39.372160 1365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:39.372411 1365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:39.374614 1365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "7d1e53972601420c8b7d12af10885406"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "6777518c8aa77f0ab6d1ae9a4c29c9f6"
server_key_iv: "2913413955a5e45d8df5069022da7f61"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.375226 1365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "7d1e53972601420c8b7d12af10885406"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "6777518c8aa77f0ab6d1ae9a4c29c9f6"
server_key_iv: "2913413955a5e45d8df5069022da7f61"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.379180 1365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:39.381726 1390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.383219 1365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:17:39.383361 1365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "7d1e53972601420c8b7d12af10885406"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "6777518c8aa77f0ab6d1ae9a4c29c9f6"
server_key_iv: "2913413955a5e45d8df5069022da7f61"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.383476 1365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:39.393522 1365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:39.396377 1365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:39.396581 1365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:39.397157 1365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:39.397984 1365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:39.398058 1365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.398130 1365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:39.398181 1365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.407917 1365 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35605
I20260807 06:17:39.407943 1555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35605 every 8 connection(s)
I20260807 06:17:39.408509 1365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:39.410176 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1365
I20260807 06:17:39.410369 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:39.410763 27633 external_mini_cluster.cc:1428] Setting key 4d5d7ba6a08d55209cfb84b06603e3dc
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:39.424870 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.410382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:55095 (local address 127.26.252.126:33905)
0807 06:17:39.410595 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.410601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.411579 (+ 978us) server_negotiation.cc:407] Connection header received
0807 06:17:39.413334 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.413337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.413383 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.413455 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:39.415123 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.415655 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.417426 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.417653 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.417800 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.420848 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:39.420854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:39.420861 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:39.420885 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:39.422733 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.423256 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.423259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.423261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.423349 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.423745 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.423748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.423750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.423944 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:39.424056 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.424557 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.424685 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:17:39.425844 1560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.410868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:33905 (local address 127.26.252.66:55095)
0807 06:17:39.411397 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.411456 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.413090 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.413679 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.413692 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.414241 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:39.414976 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.414992 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.415786 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.415790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.417296 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.417310 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.417851 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.417858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.418101 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.418791 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:39.418819 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:39.420633 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:39.422872 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.422876 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.422889 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.423139 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.423449 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.423453 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.423455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.423631 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.424057 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:39.424065 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:39.424314 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.424498 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.424918 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":111,"threads_started":1}
I20260807 06:17:39.427168 1556 heartbeater.cc:347] Connected to a master server at 127.26.252.126:33905
I20260807 06:17:39.427448 1556 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:39.427914 1556 heartbeater.cc:511] Master 127.26.252.126:33905 requested a full tablet report, sending...
I20260807 06:17:39.428954 1087 ts_manager.cc:194] Registered new tserver with Master: 7d1e53972601420c8b7d12af10885406 (127.26.252.66:35605)
I20260807 06:17:39.429798 1087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:55095
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:39.446898 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:39.571491 1564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:39.571763 1564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:39.571851 1564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:39.575870 1564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:39.575950 1564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:39.576038 1564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:39.581287 1564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:33905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:39.582355 1564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:39.583423 1564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:39.593189 1577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.593199 1571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:39.593199 1573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:39.593839 1564 server_base.cc:1034] running on GCE node
I20260807 06:17:39.594275 1564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:39.595006 1564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:39.596200 1564 hybrid_clock.cc:648] HybridClock initialized: now 1786083459596174 us; error 39 us; skew 500 ppm
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:39.599098 1564 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:39.599928 1564 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:39.599994 1564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:39.600217 1564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:39.602268 1564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "fd7ec2e9049440a0a5ebf15bc75406ab"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "a837e1154ea98b71ac98ac5b253f2dc0"
server_key_iv: "4ba9d383962346a41fbf7e03cd9f06ed"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.602926 1564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "fd7ec2e9049440a0a5ebf15bc75406ab"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "a837e1154ea98b71ac98ac5b253f2dc0"
server_key_iv: "4ba9d383962346a41fbf7e03cd9f06ed"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.606813 1564 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:17:39.609225 1589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.610580 1564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:39.610697 1564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "fd7ec2e9049440a0a5ebf15bc75406ab"
format_stamp: "Formatted at 2026-08-07 06:17:39 on dist-test-slave-68xk"
server_key: "a837e1154ea98b71ac98ac5b253f2dc0"
server_key_iv: "4ba9d383962346a41fbf7e03cd9f06ed"
server_key_version: "encryptionkey@0"
I20260807 06:17:39.610805 1564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:39.626142 1564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:39.629005 1564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:39.629205 1564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:39.629807 1564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:39.630705 1564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:39.630755 1564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.630793 1564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:39.630842 1564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:39.640316 1564 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:35135
I20260807 06:17:39.640406 1753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:35135 every 8 connection(s)
I20260807 06:17:39.640935 1564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:39.642721 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1564
I20260807 06:17:39.642863 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:39.643180 27633 external_mini_cluster.cc:1428] Setting key 821dcb3f6483a15b86b286710f1507ea
Aug 07 06:17:39 dist-test-slave-68xk krb5kdc[1019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:39.654037 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.642794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58275 (local address 127.26.252.126:33905)
0807 06:17:39.643589 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.643596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.643864 (+ 268us) server_negotiation.cc:407] Connection header received
0807 06:17:39.645365 (+ 1501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.645367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.645410 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.645476 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:39.646716 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.647247 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.648371 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.648578 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.648657 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.650960 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:39.650963 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:39.650965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:39.650988 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:39.652248 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.652750 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.652752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.652753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.652829 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.653128 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.653130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.653131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.653311 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:39.653388 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.653818 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.653918 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691}
I20260807 06:17:39.654897 1761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.643182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:33905 (local address 127.26.252.67:58275)
0807 06:17:39.643712 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.643766 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.645179 (+ 1413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.645603 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.645609 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.645954 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:39.646479 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.646505 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.647372 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.647375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.648260 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.648270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.648706 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.648708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.648843 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.649357 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:39.649373 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:39.650812 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:39.652384 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.652388 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.652399 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.652660 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.652908 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:39.652910 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:39.652912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:39.653048 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:39.653400 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:39.653405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:39.653616 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.653769 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.654003 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":127,"threads_started":1}
I20260807 06:17:39.656167 1754 heartbeater.cc:347] Connected to a master server at 127.26.252.126:33905
I20260807 06:17:39.656459 1754 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:39.656955 1754 heartbeater.cc:511] Master 127.26.252.126:33905 requested a full tablet report, sending...
I20260807 06:17:39.657955 1087 ts_manager.cc:194] Registered new tserver with Master: fd7ec2e9049440a0a5ebf15bc75406ab (127.26.252.67:35135)
I20260807 06:17:39.658636 1087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:58275
I20260807 06:17:39.668725 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:17:39.677847 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.670677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41076 (local address 127.26.252.126:33905)
0807 06:17:39.670820 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.670825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.670973 (+ 148us) server_negotiation.cc:407] Connection header received
0807 06:17:39.671147 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.671151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.671195 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.671277 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:39.671936 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.672467 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.673274 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.673487 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.673570 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.674906 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:39.674908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:39.674910 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:39.674933 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:39.676245 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.676667 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.676670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.676671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.676756 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:39.677008 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:39.677010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:39.677011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:39.677230 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:39.677339 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.677528 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.677660 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:17:39.680529 1087 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:39.683521 1087 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:39.698624 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.692213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:35135 (local address 127.0.0.1:33354)
0807 06:17:39.692632 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.692698 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.692821 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.694014 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.694021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.694046 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:39.694222 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.694229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.696024 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.696029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.697006 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.697016 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.698109 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.698113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.698217 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.698254 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.698297 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.698465 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":94,"thread_start_us":138,"threads_started":1}
I20260807 06:17:39.698966 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.693097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.26.252.66:35605)
0807 06:17:39.693855 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.693871 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.693892 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:17:39.693995 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.694000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.694205 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.694370 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:39.694603 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.695518 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.697161 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.697777 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.697912 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.698080 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.698698 (+ 618us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.698804 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":126,"threads_started":1}
I20260807 06:17:39.698974 1775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.692422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.26.252.67:35135)
0807 06:17:39.693486 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.693498 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.693522 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:17:39.693602 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.693608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.693839 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.694006 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:39.694660 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.695854 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.697138 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.697959 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.698484 (+ 525us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.698625 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.698695 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.698794 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":958,"thread_start_us":201,"threads_started":1}
I20260807 06:17:39.698625 1774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.692462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35605 (local address 127.0.0.1:46268)
0807 06:17:39.693132 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.693146 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.693238 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.694363 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.694366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.694384 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:39.694512 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.694519 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.695680 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.695686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.697007 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.697018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.697924 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.697928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.698072 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.698126 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.698274 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.698453 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":6,"thread_start_us":99,"threads_started":1}
I20260807 06:17:39.700675 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.693078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46877 (local address 127.0.0.1:60618)
0807 06:17:39.693569 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.693584 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.693685 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.694496 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.694499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.694512 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:39.694620 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.694629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.696088 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.696091 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.698130 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.698139 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.700229 (+ 2090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.700233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.700341 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.700365 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.700471 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.700543 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":110,"threads_started":1}
I20260807 06:17:39.701009 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.693521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60618 (local address 127.26.252.65:46877)
0807 06:17:39.693910 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.693919 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.693944 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:17:39.694018 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.694023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.694235 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.694401 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:39.694860 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.695950 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.698272 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.699902 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.700024 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.700138 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.700522 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.700620 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":117,"threads_started":1}
I20260807 06:17:39.702143 1659 tablet_service.cc:1467] Processing CreateTablet for tablet d5ce888e0c30431983aad8ab387640ab (DEFAULT_TABLE table=test-table [id=b430518f5b1540e9ad671781a40f1253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:39.702375 1460 tablet_service.cc:1467] Processing CreateTablet for tablet d5ce888e0c30431983aad8ab387640ab (DEFAULT_TABLE table=test-table [id=b430518f5b1540e9ad671781a40f1253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:39.703478 1659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ce888e0c30431983aad8ab387640ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:39.704007 1460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ce888e0c30431983aad8ab387640ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:39.703855 1269 tablet_service.cc:1467] Processing CreateTablet for tablet d5ce888e0c30431983aad8ab387640ab (DEFAULT_TABLE table=test-table [id=b430518f5b1540e9ad671781a40f1253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:39.704962 1269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5ce888e0c30431983aad8ab387640ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:39.710031 1779 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Bootstrap starting.
I20260807 06:17:39.711763 1781 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Bootstrap starting.
I20260807 06:17:39.712627 1779 tablet_bootstrap.cc:654] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:39.713238 1782 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: Bootstrap starting.
I20260807 06:17:39.714064 1781 tablet_bootstrap.cc:654] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:39.714203 1779 log.cc:824] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:39.715505 1781 log.cc:824] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:39.715651 1782 tablet_bootstrap.cc:654] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:39.716486 1779 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: No bootstrap required, opened a new log
I20260807 06:17:39.716691 1779 ts_tablet_manager.cc:1397] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 06:17:39.716691 1782 log.cc:824] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:39.717694 1781 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: No bootstrap required, opened a new log
I20260807 06:17:39.717881 1781 ts_tablet_manager.cc:1397] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:17:39.718595 1782 tablet_bootstrap.cc:492] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: No bootstrap required, opened a new log
I20260807 06:17:39.718803 1782 ts_tablet_manager.cc:1397] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:17:39.720928 1779 raft_consensus.cc:348] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.721342 1779 raft_consensus.cc:374] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:39.721446 1779 raft_consensus.cc:729] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd7ec2e9049440a0a5ebf15bc75406ab, State: Initialized, Role: FOLLOWER
I20260807 06:17:39.721664 1781 raft_consensus.cc:348] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.721927 1781 raft_consensus.cc:374] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:39.721974 1781 raft_consensus.cc:729] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1e53972601420c8b7d12af10885406, State: Initialized, Role: FOLLOWER
I20260807 06:17:39.721995 1779 consensus_queue.cc:260] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.722498 1781 consensus_queue.cc:260] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.722802 1754 heartbeater.cc:503] Master 127.26.252.126:33905 was elected leader, sending a full tablet report...
I20260807 06:17:39.723255 1556 heartbeater.cc:503] Master 127.26.252.126:33905 was elected leader, sending a full tablet report...
I20260807 06:17:39.723537 1781 ts_tablet_manager.cc:1428] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:17:39.723531 1782 raft_consensus.cc:348] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.723795 1782 raft_consensus.cc:374] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:39.723860 1782 raft_consensus.cc:729] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88182e6bd6a24bb2aeebf801c24b9bc6, State: Initialized, Role: FOLLOWER
I20260807 06:17:39.724300 1782 consensus_queue.cc:260] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.724586 1779 ts_tablet_manager.cc:1428] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260807 06:17:39.725186 1359 heartbeater.cc:503] Master 127.26.252.126:33905 was elected leader, sending a full tablet report...
I20260807 06:17:39.725454 1782 ts_tablet_manager.cc:1428] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 06:17:39.738782 1795 raft_consensus.cc:482] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:39.739015 1795 raft_consensus.cc:504] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.740198 1795 leader_election.cc:288] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd7ec2e9049440a0a5ebf15bc75406ab (127.26.252.67:35135), 88182e6bd6a24bb2aeebf801c24b9bc6 (127.26.252.65:46877)
I20260807 06:17:39.745939 1775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.740611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:39475 (local address 127.26.252.67:35135)
0807 06:17:39.740762 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.740769 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.740788 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:17:39.740847 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.740852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.740902 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.740991 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:39.741421 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.742229 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.744361 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.745056 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.745194 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.745251 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.745721 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.745807 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:17:39.745939 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.741058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:44011 (local address 127.26.252.65:46877)
0807 06:17:39.741180 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.741183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.741209 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:17:39.741250 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.741252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.741287 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.741342 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:39.741627 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.742363 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.744358 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.745007 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.745217 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.745263 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.745721 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.745814 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:17:39.746007 1560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.740388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:35135 (local address 127.26.252.66:39475)
0807 06:17:39.740545 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.740583 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.740697 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.741044 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.741047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.741123 (+ 76us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:39.741269 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.741276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.742353 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.742356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.744167 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.744180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.745199 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.745204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.745492 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.745571 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.745665 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.745816 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":297}
I20260807 06:17:39.746017 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.740693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46877 (local address 127.26.252.66:44011)
0807 06:17:39.741049 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.741062 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:39.741146 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:39.741385 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:39.741389 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:39.741411 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:39.741517 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.741521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.742490 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.742493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.744167 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:39.744180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.745199 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.745204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:39.745470 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.745581 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 06:17:39.745665 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:17:39.745816 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":287,"thread_start_us":136,"threads_started":1}
I20260807 06:17:39.746788 1682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ce888e0c30431983aad8ab387640ab" candidate_uuid: "7d1e53972601420c8b7d12af10885406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" is_pre_election: true
I20260807 06:17:39.746791 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ce888e0c30431983aad8ab387640ab" candidate_uuid: "7d1e53972601420c8b7d12af10885406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" is_pre_election: true
I20260807 06:17:39.747109 1295 raft_consensus.cc:2454] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1e53972601420c8b7d12af10885406 in term 0.
I20260807 06:17:39.747130 1682 raft_consensus.cc:2454] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1e53972601420c8b7d12af10885406 in term 0.
I20260807 06:17:39.747632 1394 leader_election.cc:302] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1e53972601420c8b7d12af10885406, fd7ec2e9049440a0a5ebf15bc75406ab; no voters:
I20260807 06:17:39.747932 1795 raft_consensus.cc:2781] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:39.748028 1795 raft_consensus.cc:482] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:39.748073 1795 raft_consensus.cc:3037] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:39.749172 1795 raft_consensus.cc:504] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.749517 1795 leader_election.cc:288] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [CANDIDATE]: Term 1 election: Requested vote from peers fd7ec2e9049440a0a5ebf15bc75406ab (127.26.252.67:35135), 88182e6bd6a24bb2aeebf801c24b9bc6 (127.26.252.65:46877)
I20260807 06:17:39.749873 1682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ce888e0c30431983aad8ab387640ab" candidate_uuid: "7d1e53972601420c8b7d12af10885406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab"
I20260807 06:17:39.749969 1295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5ce888e0c30431983aad8ab387640ab" candidate_uuid: "7d1e53972601420c8b7d12af10885406" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6"
I20260807 06:17:39.750038 1682 raft_consensus.cc:3037] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:39.750110 1295 raft_consensus.cc:3037] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:39.751246 1682 raft_consensus.cc:2454] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1e53972601420c8b7d12af10885406 in term 1.
I20260807 06:17:39.751250 1295 raft_consensus.cc:2454] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1e53972601420c8b7d12af10885406 in term 1.
I20260807 06:17:39.751595 1394 leader_election.cc:302] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1e53972601420c8b7d12af10885406, fd7ec2e9049440a0a5ebf15bc75406ab; no voters:
I20260807 06:17:39.751811 1795 raft_consensus.cc:2781] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:39.752111 1795 raft_consensus.cc:686] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1e53972601420c8b7d12af10885406, State: Running, Role: LEADER
I20260807 06:17:39.752502 1795 consensus_queue.cc:237] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } }
I20260807 06:17:39.755934 1085 catalog_manager.cc:5495] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1e53972601420c8b7d12af10885406 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "7d1e53972601420c8b7d12af10885406" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1e53972601420c8b7d12af10885406" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35605 } health_report { overall_health: HEALTHY } } }
I20260807 06:17:39.778151 1777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.774375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46274 (local address 127.26.252.66:35605)
0807 06:17:39.774590 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:39.774594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:39.774608 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:17:39.774706 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:39.774708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:39.774762 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:39.774884 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:39.775226 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.775742 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.776614 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:39.776837 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:39.776946 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:39.777280 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:39.777703 (+ 423us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:39.777842 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:39.777907 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:17:39.777975 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260807 06:17:39.784380 1295 raft_consensus.cc:1261] T d5ce888e0c30431983aad8ab387640ab P 88182e6bd6a24bb2aeebf801c24b9bc6 [term 1 FOLLOWER]: Refusing update from remote peer 7d1e53972601420c8b7d12af10885406: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:39.784399 1682 raft_consensus.cc:1261] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 1 FOLLOWER]: Refusing update from remote peer 7d1e53972601420c8b7d12af10885406: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:39.785130 1802 consensus_queue.cc:1035] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88182e6bd6a24bb2aeebf801c24b9bc6" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:39.785329 1795 consensus_queue.cc:1035] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd7ec2e9049440a0a5ebf15bc75406ab" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 35135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:39.793495 1807 mvcc.cc:205] Tried to move back new op lower bound from 7315797851269341184 to 7315797851149762560. Current Snapshot: MvccSnapshot[applied={T|T < 7315797851269341184}]
I20260807 06:17:39.794245 1808 mvcc.cc:205] Tried to move back new op lower bound from 7315797851269341184 to 7315797851149762560. Current Snapshot: MvccSnapshot[applied={T|T < 7315797851269341184}]
I20260807 06:17:39.801440 1086 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:39.801648 1086 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:39.804342 1086 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58281000f9984cd393692a263d3c50ee: Sending DeleteTablet for 3 replicas of tablet d5ce888e0c30431983aad8ab387640ab
I20260807 06:17:39.805135 1460 tablet_service.cc:1514] Processing DeleteTablet for tablet d5ce888e0c30431983aad8ab387640ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:39 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:46268
I20260807 06:17:39.805342 1659 tablet_service.cc:1514] Processing DeleteTablet for tablet d5ce888e0c30431983aad8ab387640ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:39 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:33354
I20260807 06:17:39.805419 1269 tablet_service.cc:1514] Processing DeleteTablet for tablet d5ce888e0c30431983aad8ab387640ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:39 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60618
I20260807 06:17:39.805769 1819 tablet_replica.cc:330] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: stopping tablet replica
I20260807 06:17:39.806058 1819 raft_consensus.cc:2229] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:39.806070 1820 tablet_replica.cc:330] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: stopping tablet replica
I20260807 06:17:39.806226 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1178
I20260807 06:17:39.806777 1820 raft_consensus.cc:2229] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:39.807088 1820 raft_consensus.cc:2258] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:39.808995 1819 raft_consensus.cc:2258] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:39.811846 1820 ts_tablet_manager.cc:1905] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:39.814909 1819 ts_tablet_manager.cc:1905] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:39.815261 1820 ts_tablet_manager.cc:1918] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:39.815469 1820 log.cc:1196] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/d5ce888e0c30431983aad8ab387640ab
I20260807 06:17:39.815963 1820 ts_tablet_manager.cc:1939] T d5ce888e0c30431983aad8ab387640ab P fd7ec2e9049440a0a5ebf15bc75406ab: Deleting consensus metadata
I20260807 06:17:39.817441 1064 catalog_manager.cc:4841] TS fd7ec2e9049440a0a5ebf15bc75406ab (127.26.252.67:35135): tablet d5ce888e0c30431983aad8ab387640ab (table test-table [id=b430518f5b1540e9ad671781a40f1253]) successfully deleted
W20260807 06:17:39.819527 1064 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:46877 (error 108)
I20260807 06:17:39.819677 1819 ts_tablet_manager.cc:1918] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:39.819783 1819 log.cc:1196] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/d5ce888e0c30431983aad8ab387640ab
I20260807 06:17:39.820201 1819 ts_tablet_manager.cc:1939] T d5ce888e0c30431983aad8ab387640ab P 7d1e53972601420c8b7d12af10885406: Deleting consensus metadata
I20260807 06:17:39.820827 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.820453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46877 (local address 127.0.0.1:60630)
0807 06:17:39.820644 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.820736 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:46877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 06:17:39.820843 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1365
W20260807 06:17:39.829041 1064 catalog_manager.cc:4584] TS 88182e6bd6a24bb2aeebf801c24b9bc6 (127.26.252.65:46877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5ce888e0c30431983aad8ab387640ab: Network error: Client connection negotiation failed: client connection to 127.26.252.65:46877: connect: Connection refused (error 111)
I20260807 06:17:39.837659 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1564
I20260807 06:17:39.843163 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:39.837807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35605 (local address 127.0.0.1:46280)
0807 06:17:39.842931 (+ 5124us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:39.843025 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.66:35605: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4971}
I20260807 06:17:39.854279 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1040
2026-08-07T06:17:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2516 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T06:17:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:39Z Disabled control of system clock
I20260807 06:17:39.892660 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46573
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:46573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:17:40.017454 1829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:40.017752 1829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:40.017792 1829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:40.022001 1829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:40.022076 1829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:40.022094 1829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:40.022111 1829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:40.022126 1829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:40.026902 1829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:46573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:40.027997 1829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:40.029474 1829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:40.038269 1836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.038264 1837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.038264 1840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:40.038353 1829 server_base.cc:1034] running on GCE node
I20260807 06:17:40.039222 1829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:40.040303 1829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:40.041471 1829 hybrid_clock.cc:648] HybridClock initialized: now 1786083460041432 us; error 54 us; skew 500 ppm
I20260807 06:17:40.043428 1829 webserver.cc:460] Webserver started at http://127.26.252.126:41819/ using document root <none> and password file <none>
I20260807 06:17:40.043964 1829 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:40.044025 1829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:40.044210 1829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:40.046224 1829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "8b49f5faadd2451398dc647244a26f66"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "c65b0e7c9c1dfa95f235c9a877b84116"
server_key_iv: "56ecc3e529f0a324acb591cb2fa223d6"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.046808 1829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "8b49f5faadd2451398dc647244a26f66"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "c65b0e7c9c1dfa95f235c9a877b84116"
server_key_iv: "56ecc3e529f0a324acb591cb2fa223d6"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.050649 1829 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:17:40.053047 1850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.054301 1829 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:40.054492 1829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "8b49f5faadd2451398dc647244a26f66"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "c65b0e7c9c1dfa95f235c9a877b84116"
server_key_iv: "56ecc3e529f0a324acb591cb2fa223d6"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.054617 1829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:40.059222 1829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:40.059813 1829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:40.059998 1829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:40.067121 1829 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:46573
I20260807 06:17:40.067205 1927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:46573 every 8 connection(s)
I20260807 06:17:40.068156 1829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:40.069388 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1829
I20260807 06:17:40.069527 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:40.069823 27633 external_mini_cluster.cc:1428] Setting key ec712456b637d0bfd81fe3825d926b3c
I20260807 06:17:40.071918 1928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:40.075835 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.071174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51310 (local address 127.26.252.126:46573)
0807 06:17:40.071960 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.071980 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.072023 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:17:40.072855 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.072876 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.073294 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.073655 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.074340 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.074346 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.074360 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.074372 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.074465 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.074488 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.074630 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.074708 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.074945 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":110,"threads_started":1}
I20260807 06:17:40.078612 1928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: Bootstrap starting.
I20260807 06:17:40.080627 1928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:40.081312 1928 log.cc:824] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:40.083422 1928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: No bootstrap required, opened a new log
I20260807 06:17:40.087191 1928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } }
I20260807 06:17:40.087396 1928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:40.087472 1928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b49f5faadd2451398dc647244a26f66, State: Initialized, Role: FOLLOWER
I20260807 06:17:40.087886 1928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } }
I20260807 06:17:40.088028 1928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:40.088115 1928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:40.088253 1928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:40.089102 1928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } }
I20260807 06:17:40.089445 1928 leader_election.cc:302] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b49f5faadd2451398dc647244a26f66; no voters:
I20260807 06:17:40.089785 1928 leader_election.cc:288] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:40.089921 1936 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:40.090130 1936 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [term 1 LEADER]: Becoming Leader. State: Replica: 8b49f5faadd2451398dc647244a26f66, State: Running, Role: LEADER
I20260807 06:17:40.090445 1936 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } }
I20260807 06:17:40.091074 1928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:40.092168 1939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b49f5faadd2451398dc647244a26f66. Latest consensus state: current_term: 1 leader_uuid: "8b49f5faadd2451398dc647244a26f66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } } }
I20260807 06:17:40.092306 1939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:40.092602 1937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b49f5faadd2451398dc647244a26f66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b49f5faadd2451398dc647244a26f66" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 46573 } } }
I20260807 06:17:40.092694 1937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:40.092809 1947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:40.096076 1947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:40.101498 1947 catalog_manager.cc:1347] Generated new cluster ID: f7086848daa74b1d90e1b3a413478140
I20260807 06:17:40.101567 1947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:40.116986 1947 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:40.117306 1947 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:40.129724 1947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: Generated new TSK 0
I20260807 06:17:40.130388 1947 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:17:40.140571 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--builtin_ntp_servers=127.26.252.84:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:17:40.253244 1958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:40.253479 1958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:40.253518 1958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:40.257560 1958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:40.257608 1958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:40.257710 1958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:40.262405 1958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:40.263422 1958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:40.264760 1958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:40.274361 1971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.274379 1966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.274385 1967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:40.274679 1958 server_base.cc:1034] running on GCE node
I20260807 06:17:40.275064 1958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:40.275691 1958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:40.276885 1958 hybrid_clock.cc:648] HybridClock initialized: now 1786083460276871 us; error 28 us; skew 500 ppm
I20260807 06:17:40.278856 1958 webserver.cc:460] Webserver started at http://127.26.252.65:42357/ using document root <none> and password file <none>
I20260807 06:17:40.279417 1958 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:40.279511 1958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:40.279752 1958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:40.281718 1958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "b06bad4b73a74133813f3e0dd8d14c31"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "52f7215e8a4035c6d2cc1917d7669843"
server_key_iv: "b1f84f2cfa794d6f6ebeb9d962881a04"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.282320 1958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "b06bad4b73a74133813f3e0dd8d14c31"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "52f7215e8a4035c6d2cc1917d7669843"
server_key_iv: "b1f84f2cfa794d6f6ebeb9d962881a04"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.285908 1958 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:40.288470 1981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.289667 1958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:40.289817 1958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "b06bad4b73a74133813f3e0dd8d14c31"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "52f7215e8a4035c6d2cc1917d7669843"
server_key_iv: "b1f84f2cfa794d6f6ebeb9d962881a04"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.289932 1958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:40.294759 1958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:40.295325 1958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:40.295504 1958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:40.296029 1958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:40.296892 1958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:40.296962 1958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.297029 1958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:40.297062 1958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.306116 1958 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:39807
I20260807 06:17:40.306161 2144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:39807 every 8 connection(s)
I20260807 06:17:40.307060 1958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:40.307957 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 1958
I20260807 06:17:40.308058 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:40.308387 27633 external_mini_cluster.cc:1428] Setting key 78dd0b74a06a1fecf8e6333dfd4cb269
I20260807 06:17:40.310460 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--builtin_ntp_servers=127.26.252.84:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 06:17:40.315007 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.309233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35455 (local address 127.26.252.126:46573)
0807 06:17:40.309411 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.309416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.311179 (+ 1763us) server_negotiation.cc:407] Connection header received
0807 06:17:40.312958 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.312960 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.312994 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.313069 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.314440 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.314444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.314447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.314462 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.314487 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.314497 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.314614 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.314805 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.314856 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:17:40.316001 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.309572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46573 (local address 127.26.252.65:35455)
0807 06:17:40.311003 (+ 1431us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.311047 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.312703 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.313277 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.313290 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.313413 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.314053 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.314055 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.314173 (+ 118us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.314250 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.314620 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.314634 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.314642 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.314847 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.315108 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":174,"threads_started":1}
I20260807 06:17:40.317292 2145 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46573
I20260807 06:17:40.317564 2145 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:40.318001 2145 heartbeater.cc:511] Master 127.26.252.126:46573 requested a full tablet report, sending...
I20260807 06:17:40.319690 1874 ts_manager.cc:194] Registered new tserver with Master: b06bad4b73a74133813f3e0dd8d14c31 (127.26.252.65:39807)
W20260807 06:17:40.424360 2150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:40.424664 2150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:40.424746 2150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:40.428773 2150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:40.428872 2150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:40.428972 2150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:40.433652 2150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:40.434973 2150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:40.436358 2150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:40.446653 2159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.446661 2162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.446770 2158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:40.446898 2150 server_base.cc:1034] running on GCE node
I20260807 06:17:40.447270 2150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:40.447906 2150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:40.449105 2150 hybrid_clock.cc:648] HybridClock initialized: now 1786083460449085 us; error 35 us; skew 500 ppm
I20260807 06:17:40.451186 2150 webserver.cc:460] Webserver started at http://127.26.252.66:34961/ using document root <none> and password file <none>
I20260807 06:17:40.451787 2150 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:40.451884 2150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:40.452116 2150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:40.454135 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "e516e86922d34a61aad582192decb622"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "da277e0d059beab19870e9e72d961d51"
server_key_iv: "697237801d788fc86cbc4686043ce95e"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.454730 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "e516e86922d34a61aad582192decb622"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "da277e0d059beab19870e9e72d961d51"
server_key_iv: "697237801d788fc86cbc4686043ce95e"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.458518 2150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260807 06:17:40.460978 2174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.462182 2150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:40.462311 2150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "e516e86922d34a61aad582192decb622"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "da277e0d059beab19870e9e72d961d51"
server_key_iv: "697237801d788fc86cbc4686043ce95e"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.462463 2150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:40.466871 2150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:40.467453 2150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:40.467636 2150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:40.468227 2150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:40.469230 2150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:40.469298 2150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.469363 2150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:40.469409 2150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.478288 2150 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:46701
I20260807 06:17:40.478380 2335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:46701 every 8 connection(s)
I20260807 06:17:40.479224 2150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:40.485688 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.481400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:54343 (local address 127.26.252.126:46573)
0807 06:17:40.481551 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.481556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.482688 (+ 1132us) server_negotiation.cc:407] Connection header received
0807 06:17:40.484081 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.484083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.484121 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.484198 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.485286 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.485289 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.485291 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.485301 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.485321 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.485329 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.485402 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.485535 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.485572 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:17:40.486668 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.481771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46573 (local address 127.26.252.66:54343)
0807 06:17:40.482518 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.482583 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.483886 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.484372 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.484379 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.484470 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.485013 (+ 543us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.485015 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.485069 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.485139 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.485409 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.485416 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.485421 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.485580 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.485808 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":111,"threads_started":1}
I20260807 06:17:40.487953 2336 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46573
I20260807 06:17:40.488273 2336 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:40.488502 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 2150
I20260807 06:17:40.488627 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:40.488838 2336 heartbeater.cc:511] Master 127.26.252.126:46573 requested a full tablet report, sending...
I20260807 06:17:40.488919 27633 external_mini_cluster.cc:1428] Setting key f00d54272fb1c09bb25ac3cd07bc377b
I20260807 06:17:40.489918 1873 ts_manager.cc:194] Registered new tserver with Master: e516e86922d34a61aad582192decb622 (127.26.252.66:46701)
I20260807 06:17:40.491200 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--builtin_ntp_servers=127.26.252.84:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:17:40.605633 2340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:40.605886 2340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:40.605926 2340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:40.610577 2340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:40.610632 2340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:40.610690 2340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:40.615429 2340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:46573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:40.616423 2340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:40.617758 2340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:40.627874 2347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:40.627970 2340 server_base.cc:1034] running on GCE node
W20260807 06:17:40.627841 2350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:40.627842 2348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:40.628456 2340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:40.629079 2340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:40.630286 2340 hybrid_clock.cc:648] HybridClock initialized: now 1786083460630269 us; error 29 us; skew 500 ppm
I20260807 06:17:40.632206 2340 webserver.cc:460] Webserver started at http://127.26.252.67:34785/ using document root <none> and password file <none>
I20260807 06:17:40.632789 2340 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:40.632887 2340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:40.633118 2340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:40.635355 2340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "5fe0ea018de944e0886d6252cc3e2553"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "8bcc49e0259651e121c919fa4b17edc3"
server_key_iv: "a99109c802476baf621906c39c9756e4"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.635936 2340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "5fe0ea018de944e0886d6252cc3e2553"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "8bcc49e0259651e121c919fa4b17edc3"
server_key_iv: "a99109c802476baf621906c39c9756e4"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.639686 2340 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:17:40.642264 2358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.643565 2340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:40.643666 2340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "5fe0ea018de944e0886d6252cc3e2553"
format_stamp: "Formatted at 2026-08-07 06:17:40 on dist-test-slave-68xk"
server_key: "8bcc49e0259651e121c919fa4b17edc3"
server_key_iv: "a99109c802476baf621906c39c9756e4"
server_key_version: "encryptionkey@0"
I20260807 06:17:40.643908 2340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:40.648618 2340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:40.649210 2340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:40.649385 2340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:40.649924 2340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:40.650861 2340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:40.650907 2340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.650969 2340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:40.651007 2340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:40.660324 2340 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:36605
I20260807 06:17:40.660344 2516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:36605 every 8 connection(s)
I20260807 06:17:40.661219 2340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:40.667433 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.663004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:43361 (local address 127.26.252.126:46573)
0807 06:17:40.663148 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.663194 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.664209 (+ 1015us) server_negotiation.cc:407] Connection header received
0807 06:17:40.665578 (+ 1369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.665581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.665626 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.665741 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.666907 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.666911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.666913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.666926 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.666956 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.666965 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.667064 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.667248 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.667296 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:40.668160 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 2340
I20260807 06:17:40.668253 2519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.663377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:46573 (local address 127.26.252.67:43361)
0807 06:17:40.664017 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.664056 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.665375 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.665905 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.665912 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.666042 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.666629 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.666631 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.666688 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.666756 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.667049 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.667058 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.667064 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.667282 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.667518 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":113,"threads_started":1}
I20260807 06:17:40.668314 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:40.668673 27633 external_mini_cluster.cc:1428] Setting key a1e663ca0fbc7bcb0be333d0613dc7e9
I20260807 06:17:40.669576 2517 heartbeater.cc:347] Connected to a master server at 127.26.252.126:46573
I20260807 06:17:40.669845 2517 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:40.670298 2517 heartbeater.cc:511] Master 127.26.252.126:46573 requested a full tablet report, sending...
I20260807 06:17:40.671384 1873 ts_manager.cc:194] Registered new tserver with Master: 5fe0ea018de944e0886d6252cc3e2553 (127.26.252.67:36605)
I20260807 06:17:40.682763 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:17:40.686535 1933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.684877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51314 (local address 127.26.252.126:46573)
0807 06:17:40.685010 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.685014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.685090 (+ 76us) server_negotiation.cc:407] Connection header received
0807 06:17:40.685206 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.685208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.685242 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.685312 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.686039 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.686043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.686045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.686057 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.686079 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.686090 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.686180 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.686297 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.686332 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:17:40.689548 1873 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:40.692924 1873 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:40.705441 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.701945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:46701 (local address 127.0.0.1:47590)
0807 06:17:40.702779 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.702832 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.702934 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.703667 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.703672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.703745 (+ 73us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.704589 (+ 844us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.704592 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.704615 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.704692 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.705074 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.705084 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.705089 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.705207 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.705277 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":90,"threads_started":1}
I20260807 06:17:40.705456 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.702099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47590 (local address 127.26.252.66:46701)
0807 06:17:40.702550 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.702564 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.703046 (+ 482us) server_negotiation.cc:407] Connection header received
0807 06:17:40.703113 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.703121 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.703328 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.703477 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.704840 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.704847 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.704862 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.704879 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.704929 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.704963 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.705107 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.705222 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.705297 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":102,"threads_started":1}
I20260807 06:17:40.705488 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.702007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:36605 (local address 127.0.0.1:50552)
0807 06:17:40.703212 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.703226 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.703318 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.704332 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.704339 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.704360 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.704798 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.704801 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.704810 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.704837 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.705200 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.705204 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.705207 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.705289 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.705327 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1151,"thread_start_us":127,"threads_started":1}
I20260807 06:17:40.705937 2537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.702791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.26.252.67:36605)
0807 06:17:40.703211 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.703223 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.703410 (+ 187us) server_negotiation.cc:407] Connection header received
0807 06:17:40.703472 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.703479 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.703666 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.703793 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.704983 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.704989 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.704998 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.705008 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.705057 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.705080 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.705227 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.705672 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.705741 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":141,"threads_started":1}
I20260807 06:17:40.706708 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.702296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:39807 (local address 127.0.0.1:35578)
0807 06:17:40.703451 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.703465 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.703549 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.704496 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.704499 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.704511 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.705931 (+ 1420us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.705934 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.705947 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.705978 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.706455 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.706461 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.706467 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.706557 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.706592 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"thread_start_us":103,"threads_started":1}
I20260807 06:17:40.706923 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.702776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.26.252.65:39807)
0807 06:17:40.703435 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.703448 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.703562 (+ 114us) server_negotiation.cc:407] Connection header received
0807 06:17:40.703655 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.703660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.703808 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.703923 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.706197 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.706202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.706234 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.706248 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.706293 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.706334 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.706471 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.706618 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.706689 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":106,"threads_started":1}
I20260807 06:17:40.708681 2251 tablet_service.cc:1467] Processing CreateTablet for tablet 77330b125d6b4296b053f2151d6be204 (DEFAULT_TABLE table=test-table [id=6590e7f3abe94b019e822827001f61bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:40.708920 2423 tablet_service.cc:1467] Processing CreateTablet for tablet 77330b125d6b4296b053f2151d6be204 (DEFAULT_TABLE table=test-table [id=6590e7f3abe94b019e822827001f61bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:40.709873 2251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77330b125d6b4296b053f2151d6be204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:40.709913 2423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77330b125d6b4296b053f2151d6be204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:40.709707 2057 tablet_service.cc:1467] Processing CreateTablet for tablet 77330b125d6b4296b053f2151d6be204 (DEFAULT_TABLE table=test-table [id=6590e7f3abe94b019e822827001f61bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:40.710685 2057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77330b125d6b4296b053f2151d6be204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:40.716027 2538 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Bootstrap starting.
I20260807 06:17:40.717373 2541 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Bootstrap starting.
I20260807 06:17:40.717868 2540 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Bootstrap starting.
I20260807 06:17:40.719620 2541 tablet_bootstrap.cc:654] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:40.719630 2538 tablet_bootstrap.cc:654] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:40.719662 2540 tablet_bootstrap.cc:654] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:40.720407 2540 log.cc:824] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:40.720511 2541 log.cc:824] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:40.720511 2538 log.cc:824] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:40.722289 2540 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: No bootstrap required, opened a new log
I20260807 06:17:40.722290 2541 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: No bootstrap required, opened a new log
I20260807 06:17:40.722528 2540 ts_tablet_manager.cc:1397] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:17:40.722543 2541 ts_tablet_manager.cc:1397] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 06:17:40.723729 2538 tablet_bootstrap.cc:492] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: No bootstrap required, opened a new log
I20260807 06:17:40.723903 2538 ts_tablet_manager.cc:1397] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 06:17:40.726233 2540 raft_consensus.cc:348] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.726673 2540 raft_consensus.cc:374] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:40.726763 2540 raft_consensus.cc:729] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e516e86922d34a61aad582192decb622, State: Initialized, Role: FOLLOWER
I20260807 06:17:40.727229 2540 consensus_queue.cc:260] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.727360 2541 raft_consensus.cc:348] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.727622 2541 raft_consensus.cc:374] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:40.727682 2541 raft_consensus.cc:729] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06bad4b73a74133813f3e0dd8d14c31, State: Initialized, Role: FOLLOWER
I20260807 06:17:40.728048 2336 heartbeater.cc:503] Master 127.26.252.126:46573 was elected leader, sending a full tablet report...
I20260807 06:17:40.728160 2541 consensus_queue.cc:260] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.728307 2540 ts_tablet_manager.cc:1428] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:17:40.728644 2538 raft_consensus.cc:348] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.728889 2538 raft_consensus.cc:374] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:40.728955 2538 raft_consensus.cc:729] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fe0ea018de944e0886d6252cc3e2553, State: Initialized, Role: FOLLOWER
I20260807 06:17:40.729161 2541 ts_tablet_manager.cc:1428] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 06:17:40.729400 2538 consensus_queue.cc:260] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.729550 2145 heartbeater.cc:503] Master 127.26.252.126:46573 was elected leader, sending a full tablet report...
I20260807 06:17:40.730098 2517 heartbeater.cc:503] Master 127.26.252.126:46573 was elected leader, sending a full tablet report...
I20260807 06:17:40.731063 2538 ts_tablet_manager.cc:1428] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260807 06:17:40.731035 2337 tablet.cc:2369] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:17:40.808296 2146 tablet.cc:2369] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:40.864771 2545 raft_consensus.cc:482] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:40.865001 2545 raft_consensus.cc:504] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.866300 2545 leader_election.cc:288] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fe0ea018de944e0886d6252cc3e2553 (127.26.252.67:36605), b06bad4b73a74133813f3e0dd8d14c31 (127.26.252.65:39807)
I20260807 06:17:40.868287 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.866619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:36605 (local address 127.26.252.66:54907)
0807 06:17:40.866766 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.866785 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.866886 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.867145 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.867148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.867163 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.867735 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.867736 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.867747 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.867774 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.868035 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.868038 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.868042 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.868122 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.868161 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 06:17:40.868306 2537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.866702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:54907 (local address 127.26.252.67:36605)
0807 06:17:40.866880 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.866892 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.866908 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:17:40.866973 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.866978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.867015 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.867129 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.867896 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.867900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.867902 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.867914 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.867937 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.867953 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.868051 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.868160 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.868203 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 06:17:40.868861 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.866714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:40459 (local address 127.26.252.65:39807)
0807 06:17:40.866851 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.866855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.867442 (+ 587us) server_negotiation.cc:407] Connection header received
0807 06:17:40.867576 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.867579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.867623 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.867714 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.868407 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.868410 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.868413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.868427 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.868450 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.868460 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.868538 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.868693 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.868739 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:17:40.868865 2550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.866946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:39807 (local address 127.26.252.66:40459)
0807 06:17:40.867338 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.867349 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:40.867459 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:40.867730 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:40.867733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:40.867747 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:40.868241 (+ 494us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:17:40.868245 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:40.868260 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:17:40.868284 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:40.868578 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:40.868581 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:40.868585 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:17:40.868670 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:17:40.868699 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":160,"threads_started":1}
I20260807 06:17:40.869072 2450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77330b125d6b4296b053f2151d6be204" candidate_uuid: "e516e86922d34a61aad582192decb622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fe0ea018de944e0886d6252cc3e2553" is_pre_election: true
I20260807 06:17:40.869439 2450 raft_consensus.cc:2454] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e516e86922d34a61aad582192decb622 in term 0.
I20260807 06:17:40.869438 2084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77330b125d6b4296b053f2151d6be204" candidate_uuid: "e516e86922d34a61aad582192decb622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06bad4b73a74133813f3e0dd8d14c31" is_pre_election: true
I20260807 06:17:40.869709 2084 raft_consensus.cc:2454] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e516e86922d34a61aad582192decb622 in term 0.
I20260807 06:17:40.869926 2178 leader_election.cc:302] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fe0ea018de944e0886d6252cc3e2553, e516e86922d34a61aad582192decb622; no voters:
I20260807 06:17:40.870230 2545 raft_consensus.cc:2781] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:40.870309 2545 raft_consensus.cc:482] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:40.870340 2545 raft_consensus.cc:3037] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:40.871575 2545 raft_consensus.cc:504] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.871949 2545 leader_election.cc:288] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [CANDIDATE]: Term 1 election: Requested vote from peers 5fe0ea018de944e0886d6252cc3e2553 (127.26.252.67:36605), b06bad4b73a74133813f3e0dd8d14c31 (127.26.252.65:39807)
I20260807 06:17:40.872323 2450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77330b125d6b4296b053f2151d6be204" candidate_uuid: "e516e86922d34a61aad582192decb622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fe0ea018de944e0886d6252cc3e2553"
I20260807 06:17:40.872359 2084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77330b125d6b4296b053f2151d6be204" candidate_uuid: "e516e86922d34a61aad582192decb622" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06bad4b73a74133813f3e0dd8d14c31"
I20260807 06:17:40.872462 2450 raft_consensus.cc:3037] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:40.872504 2084 raft_consensus.cc:3037] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:40.873549 2450 raft_consensus.cc:2454] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e516e86922d34a61aad582192decb622 in term 1.
I20260807 06:17:40.873644 2084 raft_consensus.cc:2454] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e516e86922d34a61aad582192decb622 in term 1.
I20260807 06:17:40.873845 2178 leader_election.cc:302] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fe0ea018de944e0886d6252cc3e2553, e516e86922d34a61aad582192decb622; no voters:
I20260807 06:17:40.874070 2545 raft_consensus.cc:2781] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:40.874353 2545 raft_consensus.cc:686] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 1 LEADER]: Becoming Leader. State: Replica: e516e86922d34a61aad582192decb622, State: Running, Role: LEADER
I20260807 06:17:40.874722 2545 consensus_queue.cc:237] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } }
I20260807 06:17:40.878243 1874 catalog_manager.cc:5495] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 reported cstate change: term changed from 0 to 1, leader changed from <none> to e516e86922d34a61aad582192decb622 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "e516e86922d34a61aad582192decb622" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e516e86922d34a61aad582192decb622" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 46701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:40.896775 2533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.895021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.26.252.66:46701)
0807 06:17:40.895169 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:40.895176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:40.895191 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:40.895401 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:40.895407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:40.895475 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:40.895573 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:40.896332 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:40.896336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:40.896339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:40.896350 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:40.896373 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:40.896389 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:40.896486 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:40.896570 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:17:40.896612 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:17:40.903139 2084 raft_consensus.cc:1261] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 1 FOLLOWER]: Refusing update from remote peer e516e86922d34a61aad582192decb622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:40.903167 2450 raft_consensus.cc:1261] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 1 FOLLOWER]: Refusing update from remote peer e516e86922d34a61aad582192decb622: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:40.903997 2551 consensus_queue.cc:1035] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fe0ea018de944e0886d6252cc3e2553" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:40.904209 2545 consensus_queue.cc:1035] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06bad4b73a74133813f3e0dd8d14c31" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 39807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:40.913138 2556 mvcc.cc:205] Tried to move back new op lower bound from 7315797855851315200 to 7315797855745560576. Current Snapshot: MvccSnapshot[applied={T|T < 7315797855851315200}]
I20260807 06:17:40.913784 2557 mvcc.cc:205] Tried to move back new op lower bound from 7315797855851315200 to 7315797855745560576. Current Snapshot: MvccSnapshot[applied={T|T < 7315797855851315200}]
I20260807 06:17:40.921517 1867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:40.921711 1867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:40.924436 1867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b49f5faadd2451398dc647244a26f66: Sending DeleteTablet for 3 replicas of tablet 77330b125d6b4296b053f2151d6be204
I20260807 06:17:40.925304 2423 tablet_service.cc:1514] Processing DeleteTablet for tablet 77330b125d6b4296b053f2151d6be204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:40 UTC) from {username='slave'} at 127.0.0.1:50552
I20260807 06:17:40.925503 2251 tablet_service.cc:1514] Processing DeleteTablet for tablet 77330b125d6b4296b053f2151d6be204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:40 UTC) from {username='slave'} at 127.0.0.1:47590
I20260807 06:17:40.925876 2057 tablet_service.cc:1514] Processing DeleteTablet for tablet 77330b125d6b4296b053f2151d6be204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:40 UTC) from {username='slave'} at 127.0.0.1:35578
I20260807 06:17:40.925979 2569 tablet_replica.cc:330] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: stopping tablet replica
I20260807 06:17:40.926311 2569 raft_consensus.cc:2229] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:40.926373 2570 tablet_replica.cc:330] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31: stopping tablet replica
I20260807 06:17:40.926682 2569 raft_consensus.cc:2258] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:40.926903 2570 raft_consensus.cc:2229] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:40.926961 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1958
I20260807 06:17:40.927282 2570 raft_consensus.cc:2258] T 77330b125d6b4296b053f2151d6be204 P b06bad4b73a74133813f3e0dd8d14c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:40.928221 2569 ts_tablet_manager.cc:1905] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:40.931767 2569 ts_tablet_manager.cc:1918] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:40.931865 2569 log.cc:1196] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/77330b125d6b4296b053f2151d6be204
I20260807 06:17:40.932157 2569 ts_tablet_manager.cc:1939] T 77330b125d6b4296b053f2151d6be204 P e516e86922d34a61aad582192decb622: Deleting consensus metadata
I20260807 06:17:40.933373 2568 tablet_replica.cc:330] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: stopping tablet replica
I20260807 06:17:40.933753 2568 raft_consensus.cc:2229] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:40.933805 1852 catalog_manager.cc:4841] TS e516e86922d34a61aad582192decb622 (127.26.252.66:46701): tablet 77330b125d6b4296b053f2151d6be204 (table test-table [id=6590e7f3abe94b019e822827001f61bc]) successfully deleted
I20260807 06:17:40.934161 2568 raft_consensus.cc:2258] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:40.935613 2568 ts_tablet_manager.cc:1905] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:40.938338 2568 ts_tablet_manager.cc:1918] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:40.938468 2568 log.cc:1196] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/77330b125d6b4296b053f2151d6be204
I20260807 06:17:40.938807 2568 ts_tablet_manager.cc:1939] T 77330b125d6b4296b053f2151d6be204 P 5fe0ea018de944e0886d6252cc3e2553: Deleting consensus metadata
I20260807 06:17:40.940112 1854 catalog_manager.cc:4841] TS 5fe0ea018de944e0886d6252cc3e2553 (127.26.252.67:36605): tablet 77330b125d6b4296b053f2151d6be204 (table test-table [id=6590e7f3abe94b019e822827001f61bc]) successfully deleted
W20260807 06:17:40.941919 1853 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:39807 (error 108)
I20260807 06:17:40.942906 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 2150
I20260807 06:17:40.943137 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:40.942772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:39807 (local address 127.0.0.1:35588)
0807 06:17:40.942934 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:40.943025 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:39807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 06:17:40.950109 1853 catalog_manager.cc:4584] TS b06bad4b73a74133813f3e0dd8d14c31 (127.26.252.65:39807): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77330b125d6b4296b053f2151d6be204: Network error: Client connection negotiation failed: client connection to 127.26.252.65:39807: connect: Connection refused (error 111)
I20260807 06:17:40.956223 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 2340
I20260807 06:17:40.970963 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 1829
2026-08-07T06:17:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1116 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 06:17:40.999231 27633 mini_oidc.cc:152] Starting JWKS server
I20260807 06:17:41.001061 27633 webserver.cc:460] Webserver started at https://127.0.0.1:45771/ using document root <none> and password file <none>
I20260807 06:17:41.001214 27633 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:17:41.001458 27633 webserver.cc:460] Webserver started at http://127.0.0.1:38761/ using document root <none> and password file <none>
2026-08-07T06:17:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:41Z Disabled control of system clock
I20260807 06:17:41.015463 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44595
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:45519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44595
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45771/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/testchainca.cert with env {}
W20260807 06:17:41.132838 2579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:41.133101 2579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:41.133140 2579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:41.137010 2579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:41.137056 2579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:41.137072 2579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:41.137089 2579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:41.137104 2579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:17:41.137120 2579 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:17:41.137132 2579 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45771/jwks.json
I20260807 06:17:41.142477 2579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44595
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45771/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:41.143481 2579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:41.144418 2579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:41.153416 2592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.153484 2588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.153497 2587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:41.153820 2579 server_base.cc:1034] running on GCE node
I20260807 06:17:41.154497 2579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:41.155707 2579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:41.156934 2579 hybrid_clock.cc:648] HybridClock initialized: now 1786083461156916 us; error 38 us; skew 500 ppm
I20260807 06:17:41.159111 2579 webserver.cc:460] Webserver started at http://127.26.252.126:40337/ using document root <none> and password file <none>
I20260807 06:17:41.159770 2579 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:41.159878 2579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:41.160140 2579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:41.162511 2579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "dc823b562b1c4f0f839454d5c68c4844"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "2a2196c08f4f12e85b1d70dbf97ecb18"
server_key_iv: "95922d26f8be6b4d380ca56082f35707"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.163157 2579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "dc823b562b1c4f0f839454d5c68c4844"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "2a2196c08f4f12e85b1d70dbf97ecb18"
server_key_iv: "95922d26f8be6b4d380ca56082f35707"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.167120 2579 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:41.169818 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:41.171288 2579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:41.171447 2579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "dc823b562b1c4f0f839454d5c68c4844"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "2a2196c08f4f12e85b1d70dbf97ecb18"
server_key_iv: "95922d26f8be6b4d380ca56082f35707"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.171581 2579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:41.209630 2579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:41.210592 2579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:41.210831 2579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:41.218797 2579 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44595
I20260807 06:17:41.218863 2669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44595 every 8 connection(s)
I20260807 06:17:41.219875 2579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:41.221911 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 2579
I20260807 06:17:41.222095 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:41.222468 27633 external_mini_cluster.cc:1428] Setting key 000bbceaa56538c271375af1d354e132
I20260807 06:17:41.223562 2671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:41.230983 2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844: Bootstrap starting.
I20260807 06:17:41.233795 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.223958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57142 (local address 127.26.252.126:44595)
0807 06:17:41.224685 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.224708 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.224755 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:17:41.225735 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.225760 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.226289 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.226725 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:41.227196 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.228780 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.229786 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.230556 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.230738 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.231652 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:41.231659 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:41.231675 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:41.232190 (+ 515us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:41.232274 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:41.232306 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:41.232421 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:41.232536 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:17:41.232823 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":115,"threads_started":1}
I20260807 06:17:41.233933 2671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:41.234932 2671 log.cc:824] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:41.237028 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:17:41.237351 2671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844: No bootstrap required, opened a new log
I20260807 06:17:41.241591 2671 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } }
I20260807 06:17:41.241851 2671 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:41.241917 2671 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc823b562b1c4f0f839454d5c68c4844, State: Initialized, Role: FOLLOWER
I20260807 06:17:41.242388 2671 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } }
I20260807 06:17:41.242614 2671 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:41.242692 2671 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:41.242795 2671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:41.243723 2671 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } }
I20260807 06:17:41.244123 2671 leader_election.cc:302] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc823b562b1c4f0f839454d5c68c4844; no voters:
I20260807 06:17:41.244481 2671 leader_election.cc:288] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:41.244684 2679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:41.244926 2679 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [term 1 LEADER]: Becoming Leader. State: Replica: dc823b562b1c4f0f839454d5c68c4844, State: Running, Role: LEADER
I20260807 06:17:41.245285 2679 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } }
I20260807 06:17:41.245859 2671 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:41.247084 2680 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc823b562b1c4f0f839454d5c68c4844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } } }
I20260807 06:17:41.247258 2680 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.247084 2681 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc823b562b1c4f0f839454d5c68c4844. Latest consensus state: current_term: 1 leader_uuid: "dc823b562b1c4f0f839454d5c68c4844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc823b562b1c4f0f839454d5c68c4844" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44595 } } }
I20260807 06:17:41.247426 2681 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.247722 2690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:41.251092 2690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:41.256865 2690 catalog_manager.cc:1347] Generated new cluster ID: e6f61e601ec94f3ea2c8703c33dbfe69
I20260807 06:17:41.256945 2690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:41.272990 2690 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:41.273876 2690 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:41.278517 2690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc823b562b1c4f0f839454d5c68c4844: Generated new TSK 0
I20260807 06:17:41.279305 2690 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:17:41.316416 2714 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 06:17:41.316634 2714 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:17:41.317194 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.298041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57156 (local address 127.26.252.126:44595)
0807 06:17:41.298217 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.298222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.298463 (+ 241us) server_negotiation.cc:407] Connection header received
0807 06:17:41.298714 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.298716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.298772 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.298865 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:17:41.299184 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.299753 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.301167 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.301434 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.301533 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.301948 (+ 415us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:17:41.316808 (+ 14860us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:17:41.317066 (+ 258us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57156: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 06:17:41.317304 2675 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57156: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 06:17:41.318881 2713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:41.297933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44595 (local address 127.0.0.1:57156)
0807 06:17:41.298322 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:41.298351 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:41.298531 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:41.298908 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:41.298912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:41.298921 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:17:41.299053 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.299061 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.299876 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.299880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.300986 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.300997 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.301569 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.301574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.301690 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.301745 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:17:41.317060 (+ 15315us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:17:41.317307 (+ 247us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.252.126:44595: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":127,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.252.126:44595: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45771/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 06:17:41.319810 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 2579
2026-08-07T06:17:41Z chronyd exiting
I20260807 06:17:41.364149 27633 test_util.cc:175] -----------------------------------------------
I20260807 06:17:41.364252 27633 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786083434177398-27633-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (366 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 06:17:41.365460 27633 mini_oidc.cc:152] Starting JWKS server
I20260807 06:17:41.366339 27633 webserver.cc:460] Webserver started at https://127.0.0.1:44783/ using document root <none> and password file <none>
I20260807 06:17:41.366494 27633 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:17:41.366807 27633 webserver.cc:460] Webserver started at http://127.0.0.1:42709/ using document root <none> and password file <none>
2026-08-07T06:17:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:41Z Disabled control of system clock
I20260807 06:17:41.377048 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:37993
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:46111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:37993
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44783/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/testchainca.cert with env {}
W20260807 06:17:41.494107 2722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:41.494362 2722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:41.494427 2722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:41.498385 2722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:41.498466 2722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:41.498481 2722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:41.498498 2722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:41.498513 2722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:17:41.498579 2722 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:17:41.498610 2722 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44783/jwks.json
I20260807 06:17:41.503870 2722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:37993
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:37993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44783/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:41.504902 2722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:41.505920 2722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:41.514454 2733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.514549 2731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.514490 2735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:41.514652 2722 server_base.cc:1034] running on GCE node
I20260807 06:17:41.515224 2722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:41.516319 2722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:41.517524 2722 hybrid_clock.cc:648] HybridClock initialized: now 1786083461517501 us; error 42 us; skew 500 ppm
I20260807 06:17:41.524140 2722 webserver.cc:460] Webserver started at http://127.26.252.126:39041/ using document root <none> and password file <none>
I20260807 06:17:41.524751 2722 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:41.524847 2722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:41.525105 2722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:41.527264 2722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "c26a1bb5a84942e9b266f6f52433f926"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "a13b953f26900a2dc62be62c12e76645"
server_key_iv: "95622fc095cb6df6f40137d3db844c99"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.527884 2722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "c26a1bb5a84942e9b266f6f52433f926"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "a13b953f26900a2dc62be62c12e76645"
server_key_iv: "95622fc095cb6df6f40137d3db844c99"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.531508 2722 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 06:17:41.533944 2742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:41.535205 2722 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:17:41.535359 2722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "c26a1bb5a84942e9b266f6f52433f926"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "a13b953f26900a2dc62be62c12e76645"
server_key_iv: "95622fc095cb6df6f40137d3db844c99"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.535473 2722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:41.549947 2722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:41.550743 2722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:41.550941 2722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:41.558055 2722 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:37993
I20260807 06:17:41.558066 2814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:37993 every 8 connection(s)
I20260807 06:17:41.559113 2722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:41.562343 2815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:41.563012 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 2722
I20260807 06:17:41.563148 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:41.563458 27633 external_mini_cluster.cc:1428] Setting key 8b11bf150cba2007ec01cc0638cd4c6f
I20260807 06:17:41.568992 2815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926: Bootstrap starting.
I20260807 06:17:41.571727 2815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:41.572593 2815 log.cc:824] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:41.573210 2822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.564900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58856 (local address 127.26.252.126:37993)
0807 06:17:41.565597 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.565610 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.565645 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:41.566309 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.566325 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.566821 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.567162 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:41.567504 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.568518 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.569725 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.570205 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.570337 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.571267 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:41.571272 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:41.571285 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:41.571687 (+ 402us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:41.571744 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:41.571764 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:41.571913 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:41.572096 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:17:41.572353 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":155,"threads_started":1}
I20260807 06:17:41.574870 2815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926: No bootstrap required, opened a new log
I20260807 06:17:41.576298 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:17:41.579210 2815 raft_consensus.cc:348] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } }
I20260807 06:17:41.579478 2815 raft_consensus.cc:374] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:41.579548 2815 raft_consensus.cc:729] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c26a1bb5a84942e9b266f6f52433f926, State: Initialized, Role: FOLLOWER
I20260807 06:17:41.579957 2815 consensus_queue.cc:260] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } }
I20260807 06:17:41.580111 2815 raft_consensus.cc:388] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:41.580179 2815 raft_consensus.cc:482] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:41.580284 2815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:41.581241 2815 raft_consensus.cc:504] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } }
I20260807 06:17:41.581593 2815 leader_election.cc:302] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c26a1bb5a84942e9b266f6f52433f926; no voters:
I20260807 06:17:41.581960 2815 leader_election.cc:288] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:41.582199 2825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:41.582489 2825 raft_consensus.cc:686] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [term 1 LEADER]: Becoming Leader. State: Replica: c26a1bb5a84942e9b266f6f52433f926, State: Running, Role: LEADER
I20260807 06:17:41.582840 2825 consensus_queue.cc:237] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } }
I20260807 06:17:41.583369 2815 sys_catalog.cc:564] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:41.584808 2826 sys_catalog.cc:455] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c26a1bb5a84942e9b266f6f52433f926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } } }
I20260807 06:17:41.584851 2827 sys_catalog.cc:455] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c26a1bb5a84942e9b266f6f52433f926. Latest consensus state: current_term: 1 leader_uuid: "c26a1bb5a84942e9b266f6f52433f926" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c26a1bb5a84942e9b266f6f52433f926" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37993 } } }
I20260807 06:17:41.584939 2826 sys_catalog.cc:458] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.584952 2827 sys_catalog.cc:458] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.585413 2841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:41.589293 2841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:41.594662 2841 catalog_manager.cc:1347] Generated new cluster ID: b388f6b67c554b69ae53bba245c5110d
I20260807 06:17:41.594736 2841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:41.608906 2841 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:41.610100 2841 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:41.617645 2841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c26a1bb5a84942e9b266f6f52433f926: Generated new TSK 0
I20260807 06:17:41.618386 2841 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:17:41.643579 2860 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 06:17:41.643684 2860 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:17:41.644338 2822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.628031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58872 (local address 127.26.252.126:37993)
0807 06:17:41.628166 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.628170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.628349 (+ 179us) server_negotiation.cc:407] Connection header received
0807 06:17:41.628476 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.628479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.628535 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.628653 (+ 118us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:17:41.628939 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.629783 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.630758 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.631111 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.631225 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.631491 (+ 266us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:17:41.643953 (+ 12462us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44783/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:17:41.644200 (+ 247us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44783/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 06:17:41.644404 2822 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44783/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 06:17:41.644452 2858 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:41.627884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:37993 (local address 127.0.0.1:58872)
0807 06:17:41.628259 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:41.628272 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:41.628370 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:41.628699 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:41.628702 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:41.628710 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:17:41.628821 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.628826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.629915 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.629919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.630633 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.630648 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.631234 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.631237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.631302 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.631325 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:17:41.644140 (+ 12815us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44783/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:17:41.644282 (+ 142us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.252.126:37993: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44783/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":124,"threads_started":1}
I20260807 06:17:41.645180 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 2722
2026-08-07T06:17:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (329 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 06:17:41.694398 27633 mini_oidc.cc:152] Starting JWKS server
I20260807 06:17:41.695379 27633 webserver.cc:460] Webserver started at https://127.0.0.1:41405/ using document root <none> and password file <none>
I20260807 06:17:41.695468 27633 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:17:41.695677 27633 webserver.cc:460] Webserver started at http://127.0.0.1:35217/ using document root <none> and password file <none>
2026-08-07T06:17:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:41Z Disabled control of system clock
I20260807 06:17:41.706380 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43411
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:35443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:43411
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41405/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:17:41.819757 2868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:41.820006 2868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:41.820044 2868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:41.824016 2868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:41.824071 2868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:41.824087 2868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:41.824105 2868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:41.824119 2868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:17:41.824134 2868 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:17:41.824153 2868 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41405/jwks.json
I20260807 06:17:41.828810 2868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:35443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:43411
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41405/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:41.829854 2868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:41.831265 2868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:41.839973 2875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.840044 2877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:41.840070 2874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:41.840276 2868 server_base.cc:1034] running on GCE node
I20260807 06:17:41.840879 2868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:41.842077 2868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:41.843279 2868 hybrid_clock.cc:648] HybridClock initialized: now 1786083461843265 us; error 27 us; skew 500 ppm
I20260807 06:17:41.845124 2868 webserver.cc:460] Webserver started at http://127.26.252.126:39029/ using document root <none> and password file <none>
I20260807 06:17:41.845692 2868 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:41.845755 2868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:41.845924 2868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:41.848023 2868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "2ea0c784d04a4a4281a7137115a6694b"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "0f5b272f0ad3874f00af111af67baef7"
server_key_iv: "fc9b16510dfbc47869a0a9e169784ca5"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.848543 2868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "2ea0c784d04a4a4281a7137115a6694b"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "0f5b272f0ad3874f00af111af67baef7"
server_key_iv: "fc9b16510dfbc47869a0a9e169784ca5"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.852344 2868 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260807 06:17:41.855895 2884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:41.857148 2868 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:17:41.857326 2868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "2ea0c784d04a4a4281a7137115a6694b"
format_stamp: "Formatted at 2026-08-07 06:17:41 on dist-test-slave-68xk"
server_key: "0f5b272f0ad3874f00af111af67baef7"
server_key_iv: "fc9b16510dfbc47869a0a9e169784ca5"
server_key_version: "encryptionkey@0"
I20260807 06:17:41.857457 2868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:41.897158 2868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:41.897955 2868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:41.898175 2868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:41.905774 2868 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:43411
I20260807 06:17:41.905789 2964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:43411 every 8 connection(s)
I20260807 06:17:41.906829 2868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:41.910213 2965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:41.912907 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 2868
I20260807 06:17:41.913045 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:41.913358 27633 external_mini_cluster.cc:1428] Setting key 25710d0520f9ad652a853b30dc5184dd
I20260807 06:17:41.916554 2965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b: Bootstrap starting.
I20260807 06:17:41.918902 2965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:41.919634 2965 log.cc:824] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:41.921612 2965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b: No bootstrap required, opened a new log
I20260807 06:17:41.922802 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.914835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35868 (local address 127.26.252.126:43411)
0807 06:17:41.915501 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.915517 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.915553 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:17:41.916181 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.916198 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.916590 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.916979 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:41.917418 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.918382 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.919392 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.919926 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.920097 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.921013 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:41.921024 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:41.921037 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:41.921421 (+ 384us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:41.921477 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:41.921497 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:41.921605 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:41.921779 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:17:41.922033 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":139,"threads_started":1}
I20260807 06:17:41.930750 2965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } }
I20260807 06:17:41.931104 2965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:41.931185 2965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea0c784d04a4a4281a7137115a6694b, State: Initialized, Role: FOLLOWER
I20260807 06:17:41.931469 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:17:41.931828 2965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } }
I20260807 06:17:41.932046 2965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:41.932134 2965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:41.932261 2965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:41.933945 2965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } }
I20260807 06:17:41.934393 2965 leader_election.cc:302] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ea0c784d04a4a4281a7137115a6694b; no voters:
I20260807 06:17:41.934847 2965 leader_election.cc:288] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:41.935017 2971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:41.935293 2971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [term 1 LEADER]: Becoming Leader. State: Replica: 2ea0c784d04a4a4281a7137115a6694b, State: Running, Role: LEADER
I20260807 06:17:41.935609 2971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } }
I20260807 06:17:41.936503 2965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:41.936764 2971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ea0c784d04a4a4281a7137115a6694b. Latest consensus state: current_term: 1 leader_uuid: "2ea0c784d04a4a4281a7137115a6694b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } } }
I20260807 06:17:41.936921 2971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.937163 2972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ea0c784d04a4a4281a7137115a6694b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ea0c784d04a4a4281a7137115a6694b" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43411 } } }
I20260807 06:17:41.937247 2972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:41.938934 2977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:41.942884 2977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:41.949184 2977 catalog_manager.cc:1347] Generated new cluster ID: 0d8e96e387d04eb8b2e677a4522ea26a
I20260807 06:17:41.949260 2977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:41.963493 2977 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:41.964955 2977 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:41.974933 2977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ea0c784d04a4a4281a7137115a6694b: Generated new TSK 0
I20260807 06:17:41.975874 2977 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:17:41.994479 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:41.987284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35874 (local address 127.26.252.126:43411)
0807 06:17:41.987403 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:41.987408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:41.987707 (+ 299us) server_negotiation.cc:407] Connection header received
0807 06:17:41.987877 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:41.987881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:41.987965 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:41.988100 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:17:41.988370 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.989364 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.990719 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.991218 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.991370 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.991814 (+ 444us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:17:41.993684 (+ 1870us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:17:41.994232 (+ 548us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35874: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 06:17:41.994570 2968 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35874: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 06:17:41.997344 3001 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:41.987215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43411 (local address 127.0.0.1:35874)
0807 06:17:41.987586 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:41.987603 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:41.987735 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:41.988107 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:41.988110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:41.988119 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:17:41.988242 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.988249 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.989513 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.989517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.990561 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:41.990572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:41.991397 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:41.991402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:41.991518 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:41.991550 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:17:41.993900 (+ 2350us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:17:41.997066 (+ 3166us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.252.126:43411: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":2923,"thread_start_us":134,"threads_started":1}
I20260807 06:17:41.997857 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 2868
E20260807 06:17:42.022168 3002 webserver.cc:533] Webserver: sslize failed:
E20260807 06:17:42.022256 3002 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T06:17:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (359 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T06:17:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:42Z Disabled control of system clock
I20260807 06:17:42.064536 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40737
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:46613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:40737
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/testchainca.cert with env {}
W20260807 06:17:42.178576 3007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:42.178867 3007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:42.178941 3007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:42.182880 3007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:42.182966 3007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:42.182996 3007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:42.183035 3007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:42.183066 3007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:17:42.183100 3007 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:17:42.183135 3007 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 06:17:42.188277 3007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:40737
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:42.189332 3007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:42.190356 3007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:42.198616 3014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:42.198608 3016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:42.198616 3012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:42.198874 3007 server_base.cc:1034] running on GCE node
I20260807 06:17:42.199440 3007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:42.200481 3007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:42.201710 3007 hybrid_clock.cc:648] HybridClock initialized: now 1786083462201689 us; error 31 us; skew 500 ppm
I20260807 06:17:42.203687 3007 webserver.cc:460] Webserver started at http://127.26.252.126:40313/ using document root <none> and password file <none>
I20260807 06:17:42.204277 3007 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:42.204373 3007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:42.204607 3007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:42.206682 3007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "77d6c7ca55cf4e4da75ad0827ea8a278"
format_stamp: "Formatted at 2026-08-07 06:17:42 on dist-test-slave-68xk"
server_key: "e2d9148097a4303ece4c23cfc3fd5607"
server_key_iv: "aeefbeed1d1f1b88a9886c10ba462277"
server_key_version: "encryptionkey@0"
I20260807 06:17:42.207240 3007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "77d6c7ca55cf4e4da75ad0827ea8a278"
format_stamp: "Formatted at 2026-08-07 06:17:42 on dist-test-slave-68xk"
server_key: "e2d9148097a4303ece4c23cfc3fd5607"
server_key_iv: "aeefbeed1d1f1b88a9886c10ba462277"
server_key_version: "encryptionkey@0"
I20260807 06:17:42.210927 3007 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:17:42.213402 3024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:42.214622 3007 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:42.214759 3007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "77d6c7ca55cf4e4da75ad0827ea8a278"
format_stamp: "Formatted at 2026-08-07 06:17:42 on dist-test-slave-68xk"
server_key: "e2d9148097a4303ece4c23cfc3fd5607"
server_key_iv: "aeefbeed1d1f1b88a9886c10ba462277"
server_key_version: "encryptionkey@0"
I20260807 06:17:42.214866 3007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:42.243512 3007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:42.244205 3007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:42.244402 3007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:42.251466 3007 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:40737
I20260807 06:17:42.251507 3093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:40737 every 8 connection(s)
I20260807 06:17:42.252427 3007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:42.255324 3095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:42.260730 3095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: Bootstrap starting.
I20260807 06:17:42.261060 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3007
I20260807 06:17:42.261204 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:42.261482 27633 external_mini_cluster.cc:1428] Setting key c8f33eaabd8e1a14e46609e5e9d77c2d
I20260807 06:17:42.263316 3095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:42.264039 3095 log.cc:824] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:42.266059 3095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: No bootstrap required, opened a new log
I20260807 06:17:42.270475 3095 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } }
I20260807 06:17:42.270706 3095 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:42.270767 3095 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d6c7ca55cf4e4da75ad0827ea8a278, State: Initialized, Role: FOLLOWER
I20260807 06:17:42.271081 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:42.262885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42008 (local address 127.26.252.126:40737)
0807 06:17:42.263540 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:42.263554 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:42.263589 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:42.264242 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:42.264261 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:42.264652 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:42.264915 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:42.265273 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.266290 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.267525 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.268028 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.268157 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:42.269037 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:42.269042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:42.269054 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:17:42.269452 (+ 398us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:42.269508 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:17:42.269529 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:42.269606 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:42.269856 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 06:17:42.270174 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":135,"threads_started":1}
I20260807 06:17:42.271281 3095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } }
I20260807 06:17:42.271456 3095 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:42.271525 3095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:42.271622 3095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:42.272734 3095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } }
I20260807 06:17:42.273113 3095 leader_election.cc:302] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77d6c7ca55cf4e4da75ad0827ea8a278; no voters:
I20260807 06:17:42.273512 3095 leader_election.cc:288] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:42.273624 3104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:42.273829 3104 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [term 1 LEADER]: Becoming Leader. State: Replica: 77d6c7ca55cf4e4da75ad0827ea8a278, State: Running, Role: LEADER
I20260807 06:17:42.274123 3104 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } }
I20260807 06:17:42.274263 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:17:42.274814 3095 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:42.275481 3107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77d6c7ca55cf4e4da75ad0827ea8a278. Latest consensus state: current_term: 1 leader_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } } }
I20260807 06:17:42.275646 3107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:42.275936 3105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77d6c7ca55cf4e4da75ad0827ea8a278" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40737 } } }
I20260807 06:17:42.276036 3105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278 [sys.catalog]: This master's current role is: LEADER
W20260807 06:17:42.279983 3127 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:17:42.280071 3127 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:17:42.280166 3115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:42.280925 3115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:42.286543 3115 catalog_manager.cc:1347] Generated new cluster ID: 7e40866562e04272be4a4baca5fe5080
I20260807 06:17:42.286609 3115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:42.293470 3115 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:42.294632 3115 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:42.311282 3115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77d6c7ca55cf4e4da75ad0827ea8a278: Generated new TSK 0
I20260807 06:17:42.312028 3115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:17:42.364243 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:42.322110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42012 (local address 127.26.252.126:40737)
0807 06:17:42.322275 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:42.322281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:42.322539 (+ 258us) server_negotiation.cc:407] Connection header received
0807 06:17:42.322698 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:42.322701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:42.322752 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:42.322849 (+ 97us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:17:42.323159 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.323764 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.325019 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.325299 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.325389 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:42.325749 (+ 360us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:17:42.363825 (+ 38076us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:17:42.364109 (+ 284us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42012: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 06:17:42.364351 3101 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42012: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 06:17:42.364514 3138 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:42.322063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40737 (local address 127.0.0.1:42012)
0807 06:17:42.322433 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:42.322451 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:42.322572 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:42.322874 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:42.322877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:42.322885 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:17:42.323006 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:42.323012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.323878 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.323882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:42.324876 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:42.324886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:42.325436 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:42.325440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:42.325540 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:42.325568 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:17:42.364093 (+ 38525us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:17:42.364323 (+ 230us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.252.126:40737: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":148,"threads_started":1}
I20260807 06:17:42.365250 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3007
2026-08-07T06:17:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (336 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (133 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (128 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:42 dist-test-slave-68xk krb5kdc[3152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:42 dist-test-slave-68xk krb5kdc[3152](info): set up 2 sockets
Aug 07 06:17:42 dist-test-slave-68xk krb5kdc[3152](info): commencing operation
krb5kdc: starting...
W20260807 06:17:43.891450 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:43 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:44.025341 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35251
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:35251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:44.138260 3165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:44.138612 3165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:44.138715 3165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:44.142675 3165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:44.142721 3165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:44.142740 3165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:44.142757 3165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:44.142802 3165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:44.148046 3165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:35251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:44.149057 3165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:44.150074 3165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:44.158519 3172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.158509 3174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.158507 3165 server_base.cc:1034] running on GCE node
W20260807 06:17:44.158509 3171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.159271 3165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:44.160369 3165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:44.161554 3165 hybrid_clock.cc:648] HybridClock initialized: now 1786083464161515 us; error 52 us; skew 500 ppm
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.164436 3165 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:44.165277 3165 webserver.cc:460] Webserver started at http://127.26.252.126:36731/ using document root <none> and password file <none>
I20260807 06:17:44.165794 3165 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:44.165853 3165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:44.166009 3165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:44.168049 3165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "03b932f597044576a99bb9be964a5d41"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "a1cdd932806aa660fb341d4531a6ce9a"
server_key_iv: "59b5c1dedead1437e2725e916074cd8c"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.168560 3165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "03b932f597044576a99bb9be964a5d41"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "a1cdd932806aa660fb341d4531a6ce9a"
server_key_iv: "59b5c1dedead1437e2725e916074cd8c"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.172297 3165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:44.174962 3182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.176522 3165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:44.176656 3165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "03b932f597044576a99bb9be964a5d41"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "a1cdd932806aa660fb341d4531a6ce9a"
server_key_iv: "59b5c1dedead1437e2725e916074cd8c"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.176836 3165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:44.192343 3165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:44.196182 3165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:44.196424 3165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:44.204525 3165 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:35251
I20260807 06:17:44.204583 3260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:35251 every 8 connection(s)
I20260807 06:17:44.205677 3165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:44.208751 3261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:44.212384 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3165
I20260807 06:17:44.212496 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:44.212801 27633 external_mini_cluster.cc:1428] Setting key 8be7f318aa408c4ad11e376f1b8ce4b0
I20260807 06:17:44.214883 3261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41: Bootstrap starting.
I20260807 06:17:44.217118 3261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:44.217877 3261 log.cc:824] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:44.219811 3261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41: No bootstrap required, opened a new log
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:44.223549 3261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } }
I20260807 06:17:44.223814 3261 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:44.223908 3261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03b932f597044576a99bb9be964a5d41, State: Initialized, Role: FOLLOWER
I20260807 06:17:44.224395 3261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } }
I20260807 06:17:44.224560 3261 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:44.224637 3261 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:44.224761 3261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:44.225659 3261 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } }
I20260807 06:17:44.226037 3261 leader_election.cc:302] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03b932f597044576a99bb9be964a5d41; no voters:
I20260807 06:17:44.226449 3261 leader_election.cc:288] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:44.226576 3267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:44.226842 3267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [term 1 LEADER]: Becoming Leader. State: Replica: 03b932f597044576a99bb9be964a5d41, State: Running, Role: LEADER
I20260807 06:17:44.227200 3267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } }
I20260807 06:17:44.227411 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.214305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32890 (local address 127.26.252.126:35251)
0807 06:17:44.214815 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.214831 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.214867 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:17:44.215539 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.215555 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.215886 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.216219 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.217071 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.218156 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.219080 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.219546 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.219725 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.222223 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:44.222228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:44.222242 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:44.222270 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:44.224152 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.224595 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.224601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.224607 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.224780 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.225083 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.225087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.225089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.225483 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:44.225690 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:44.225994 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 06:17:44.226325 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":157,"threads_started":1}
I20260807 06:17:44.227748 3261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:44.228976 3269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03b932f597044576a99bb9be964a5d41. Latest consensus state: current_term: 1 leader_uuid: "03b932f597044576a99bb9be964a5d41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } } }
I20260807 06:17:44.229099 3269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:44.229456 3268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03b932f597044576a99bb9be964a5d41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03b932f597044576a99bb9be964a5d41" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35251 } } }
I20260807 06:17:44.229544 3268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:44.229971 3278 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:44.233173 3278 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:44.238950 3278 catalog_manager.cc:1347] Generated new cluster ID: a2f02da1cfd04a688d4d5aca2cc9d1bd
I20260807 06:17:44.239048 3278 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:44.264360 3278 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:44.265412 3278 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:44.275202 3278 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03b932f597044576a99bb9be964a5d41: Generated new TSK 0
I20260807 06:17:44.275952 3278 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:44.309309 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:44.425963 3294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:44.426192 3294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:44.426234 3294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:44.430528 3294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:44.430584 3294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:44.430639 3294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:44.435725 3294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:44.436627 3294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:44.437538 3294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:44.447007 3306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.447099 3303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.447074 3294 server_base.cc:1034] running on GCE node
W20260807 06:17:44.447023 3302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.447631 3294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:44.448258 3294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:44.449446 3294 hybrid_clock.cc:648] HybridClock initialized: now 1786083464449406 us; error 60 us; skew 500 ppm
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.452265 3294 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:44.453074 3294 webserver.cc:460] Webserver started at http://127.26.252.65:45653/ using document root <none> and password file <none>
I20260807 06:17:44.453642 3294 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:44.453708 3294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:44.453878 3294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:44.455955 3294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "7d88505d6b55487d8a81aa567c5b1b85"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "1894019b1cf4b0ffb4ccc62196f82583"
server_key_iv: "98c6d368c8e85383a691bd00341af55d"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.456467 3294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "7d88505d6b55487d8a81aa567c5b1b85"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "1894019b1cf4b0ffb4ccc62196f82583"
server_key_iv: "98c6d368c8e85383a691bd00341af55d"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.460633 3294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:44.463181 3313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.464510 3294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:44.464645 3294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "7d88505d6b55487d8a81aa567c5b1b85"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "1894019b1cf4b0ffb4ccc62196f82583"
server_key_iv: "98c6d368c8e85383a691bd00341af55d"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.464759 3294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:44.485412 3294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:44.488739 3294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:44.488943 3294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:44.489601 3294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:44.490665 3294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:44.490725 3294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.490796 3294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:44.490828 3294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.500149 3294 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:39853
I20260807 06:17:44.500183 3460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:39853 every 8 connection(s)
I20260807 06:17:44.501080 3294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:44.506685 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3294
I20260807 06:17:44.506793 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:44.507107 27633 external_mini_cluster.cc:1428] Setting key 32be2bb136de9ad59ee6ec0bbcd20fa9
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:44.517174 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.503025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:47111 (local address 127.26.252.126:35251)
0807 06:17:44.503225 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.503228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.504143 (+ 915us) server_negotiation.cc:407] Connection header received
0807 06:17:44.505730 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.505734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.505798 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.505916 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.507466 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.508176 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.509960 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.510193 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.510296 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.513235 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:44.513239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:44.513241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:44.513266 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:44.514889 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.515485 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.515496 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.515498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.515583 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.515967 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.515972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.515974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.516184 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:44.516305 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:44.516835 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 06:17:44.516975 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:44.518062 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.503418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35251 (local address 127.26.252.65:47111)
0807 06:17:44.503932 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:44.503979 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:44.505494 (+ 1515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:44.506115 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:44.506122 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:44.506630 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:44.507300 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.507317 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.508318 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.508322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.509808 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.509824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.510366 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.510374 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.510662 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.511431 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:44.511449 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:44.513037 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:44.515022 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.515029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.515044 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.515356 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.515701 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.515704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.515706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.515856 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.516305 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:44.516314 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:44.516566 (+ 252us) client_negotiation.cc:769] Sending connection context
0807 06:17:44.516787 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 06:17:44.517129 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":124,"threads_started":1}
I20260807 06:17:44.519399 3461 heartbeater.cc:347] Connected to a master server at 127.26.252.126:35251
I20260807 06:17:44.519624 3461 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:44.520195 3461 heartbeater.cc:511] Master 127.26.252.126:35251 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:44.521838 3213 ts_manager.cc:194] Registered new tserver with Master: 7d88505d6b55487d8a81aa567c5b1b85 (127.26.252.65:39853)
I20260807 06:17:44.523568 3213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:47111
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:44.538170 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:44.650537 3466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:44.650776 3466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:44.650818 3466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:44.654795 3466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:44.654845 3466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:44.654902 3466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:44.659893 3466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:44.660784 3466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:44.661706 3466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:44.671820 3476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.671854 3475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.671886 3480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.672034 3466 server_base.cc:1034] running on GCE node
I20260807 06:17:44.672573 3466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:44.673241 3466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:44.674497 3466 hybrid_clock.cc:648] HybridClock initialized: now 1786083464674482 us; error 28 us; skew 500 ppm
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.677448 3466 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:44.678309 3466 webserver.cc:460] Webserver started at http://127.26.252.66:46375/ using document root <none> and password file <none>
I20260807 06:17:44.678920 3466 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:44.679013 3466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:44.679252 3466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:44.681385 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "3d453558b02041098bad59fbcd8dc7e6"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "59fe54116d30f78cba98339c2bae7d0d"
server_key_iv: "c45d86e6749f94cdfbd9e3dcfe6aa889"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.682029 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "3d453558b02041098bad59fbcd8dc7e6"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "59fe54116d30f78cba98339c2bae7d0d"
server_key_iv: "c45d86e6749f94cdfbd9e3dcfe6aa889"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.685745 3466 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:44.688500 3492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.689646 3466 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 06:17:44.689787 3466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "3d453558b02041098bad59fbcd8dc7e6"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "59fe54116d30f78cba98339c2bae7d0d"
server_key_iv: "c45d86e6749f94cdfbd9e3dcfe6aa889"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.689898 3466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:44.704849 3466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:44.708166 3466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:44.708380 3466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:44.708990 3466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:44.709872 3466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:44.709942 3466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.710017 3466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:44.710062 3466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.719518 3466 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:42375
I20260807 06:17:44.719544 3645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:42375 every 8 connection(s)
I20260807 06:17:44.720412 3466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:44.725320 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3466
I20260807 06:17:44.725485 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:44.725791 27633 external_mini_cluster.cc:1428] Setting key 73d47e3b471adda690b219b601845727
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:44.735618 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.722253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:40373 (local address 127.26.252.126:35251)
0807 06:17:44.722436 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.722443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.723444 (+ 1001us) server_negotiation.cc:407] Connection header received
0807 06:17:44.724730 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.724733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.724784 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.724867 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.726181 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.727041 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.728725 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.729033 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.729096 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.731952 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:44.731958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:44.731962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:44.731994 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:44.733491 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.734009 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.734013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.734015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.734104 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.734492 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.734495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.734497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.734692 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:44.734806 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:44.735317 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 06:17:44.735443 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:44.736423 3650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.722798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35251 (local address 127.26.252.66:40373)
0807 06:17:44.723284 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:44.723329 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:44.724525 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:44.725037 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:44.725054 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:44.725422 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:44.726019 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.726034 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.727231 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.727234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.728579 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.728591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.729270 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.729273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.729474 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.730181 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:44.730198 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:44.731776 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:44.733617 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.733623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.733638 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.733903 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.734199 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.734203 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.734205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.734353 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.734817 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:44.734825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:44.735069 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 06:17:44.735262 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 06:17:44.735590 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":129,"threads_started":1}
I20260807 06:17:44.737780 3646 heartbeater.cc:347] Connected to a master server at 127.26.252.126:35251
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:44.738034 3646 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:44.738607 3646 heartbeater.cc:511] Master 127.26.252.126:35251 requested a full tablet report, sending...
I20260807 06:17:44.739751 3213 ts_manager.cc:194] Registered new tserver with Master: 3d453558b02041098bad59fbcd8dc7e6 (127.26.252.66:42375)
I20260807 06:17:44.740355 3213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:40373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:44.758368 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:44.877257 3655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:44.877521 3655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:44.877565 3655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:44.881819 3655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:44.881896 3655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:44.881958 3655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:44.887388 3655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:35251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:44.888437 3655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:44.889434 3655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:44.899552 3662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.899552 3665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:44.899613 3660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:44.899964 3655 server_base.cc:1034] running on GCE node
I20260807 06:17:44.900405 3655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:44.901027 3655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:44.902189 3655 hybrid_clock.cc:648] HybridClock initialized: now 1786083464902169 us; error 32 us; skew 500 ppm
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.905031 3655 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:44.905953 3655 webserver.cc:460] Webserver started at http://127.26.252.67:37049/ using document root <none> and password file <none>
I20260807 06:17:44.906538 3655 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:44.906608 3655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:44.906786 3655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:44.908756 3655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "c43cf2037fcb49bfaf5fa2b6c0f6b3bd"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "2844b02d0f2bbd267f8e121a7b3f29f7"
server_key_iv: "bc54329c2ac348080f6f08df8492d459"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.909284 3655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "c43cf2037fcb49bfaf5fa2b6c0f6b3bd"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "2844b02d0f2bbd267f8e121a7b3f29f7"
server_key_iv: "bc54329c2ac348080f6f08df8492d459"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.913100 3655 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:17:44.915830 3676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.917065 3655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:17:44.917162 3655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "c43cf2037fcb49bfaf5fa2b6c0f6b3bd"
format_stamp: "Formatted at 2026-08-07 06:17:44 on dist-test-slave-68xk"
server_key: "2844b02d0f2bbd267f8e121a7b3f29f7"
server_key_iv: "bc54329c2ac348080f6f08df8492d459"
server_key_version: "encryptionkey@0"
I20260807 06:17:44.917246 3655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:44.936506 3655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:44.939833 3655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:44.939993 3655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:44.940541 3655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:44.941339 3655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:44.941386 3655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.941431 3655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:44.941447 3655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:44.950935 3655 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:36713
I20260807 06:17:44.950963 3837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:36713 every 8 connection(s)
I20260807 06:17:44.951879 3655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:44.956404 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3655
I20260807 06:17:44.956547 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:44.956853 27633 external_mini_cluster.cc:1428] Setting key 026e9a072501970c55a43830511503dd
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:44.965945 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.953769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:49815 (local address 127.26.252.126:35251)
0807 06:17:44.953917 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.953921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.954773 (+ 852us) server_negotiation.cc:407] Connection header received
0807 06:17:44.956221 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.956225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.956290 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.956399 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.957948 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.958578 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.959855 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.960098 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.960213 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.962779 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:44.962782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:44.962784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:44.962809 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:44.964056 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.964560 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.964563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.964564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.964644 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:44.964955 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:44.964958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:44.964959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:44.965190 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:44.965270 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:44.965718 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 06:17:44.965822 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:17:44.966859 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.954067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35251 (local address 127.26.252.67:49815)
0807 06:17:44.954617 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:44.954663 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:44.955978 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:44.956654 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:44.956664 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:44.957091 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:44.957786 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.957812 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.958707 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.958711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.959721 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:44.959731 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.960255 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:44.960259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:44.960446 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:44.960998 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:44.961017 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:44.962640 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:44.964201 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.964205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.964216 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.964472 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.964726 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:44.964728 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:44.964729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:44.964874 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:44.965286 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:44.965290 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:44.965509 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 06:17:44.965664 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 06:17:44.965917 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":116,"threads_started":1}
I20260807 06:17:44.967998 3838 heartbeater.cc:347] Connected to a master server at 127.26.252.126:35251
I20260807 06:17:44.968281 3838 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:44.968900 3838 heartbeater.cc:511] Master 127.26.252.126:35251 requested a full tablet report, sending...
I20260807 06:17:44.970114 3212 ts_manager.cc:194] Registered new tserver with Master: c43cf2037fcb49bfaf5fa2b6c0f6b3bd (127.26.252.67:36713)
I20260807 06:17:44.970870 3212 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:49815
I20260807 06:17:44.971083 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/test-admin.keytab.
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.991508 27633 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 06:17:44.994750 3848 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:44.992939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50426 (local address 127.26.252.65:39853)
0807 06:17:44.993263 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.993280 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.993310 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:17:44.993374 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.993380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.993577 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.993757 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.994528 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50426: BlockingRecv error: recv got EOF from 127.0.0.1:50426 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":102,"threads_started":1}
W20260807 06:17:44.994884 27633 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.995970 27633 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:44.996938 27633 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:17:44 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:45.007581 3848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:44.997900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50430 (local address 127.26.252.65:39853)
0807 06:17:44.998053 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:44.998056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:44.998077 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:17:44.998173 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:44.998175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:44.998212 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:44.998287 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:44.998899 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:44.999700 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.000521 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:45.000894 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.000981 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:45.003359 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:45.003369 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:45.003381 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:45.003405 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:45.005091 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.005689 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.005695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.005697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.005839 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.006214 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.006217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.006219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.006634 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:45.006931 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:45.007144 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 06:17:45.007336 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 06:17:45.012655 3848 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:45.011237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50434 (local address 127.26.252.65:39853)
0807 06:17:45.011353 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:45.011357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:45.011785 (+ 428us) server_negotiation.cc:407] Connection header received
0807 06:17:45.011956 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:45.011959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:45.012024 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:45.012089 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:45.012507 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50434: BlockingRecv error: recv got EOF from 127.0.0.1:50434 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260807 06:17:45.012784 27633 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:45.013810 27633 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:45.014711 27633 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:45.023249 3848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:45.015544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50448 (local address 127.26.252.65:39853)
0807 06:17:45.015680 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:45.015683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:45.015696 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:45.015801 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:45.015803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:45.015837 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:45.015899 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:45.016423 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:45.016941 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.017719 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:45.017932 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.018008 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:45.020216 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:45.020219 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:45.020221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:45.020242 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:45.021796 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.022157 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.022160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.022161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.022234 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.022524 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.022527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.022528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.022678 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:45.022774 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:45.022961 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 06:17:45.023090 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 06:17:45.025652 3848 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:45.024833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50460 (local address 127.26.252.65:39853)
0807 06:17:45.024967 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:45.024972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:45.025007 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:45.025124 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:45.025126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:45.025159 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:45.025215 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:45.025568 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50460: BlockingRecv error: recv got EOF from 127.0.0.1:50460 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 06:17:45.025750 27633 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786083434177398-27633-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:45.026764 27633 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:45.027730 27633 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:17:45.037029 3848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:45.028602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.26.252.65:39853)
0807 06:17:45.028737 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:45.028741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:45.028861 (+ 120us) server_negotiation.cc:407] Connection header received
0807 06:17:45.029002 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:45.029005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:45.029043 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:45.029137 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:45.029720 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:45.030225 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.031094 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:45.031340 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:45.031453 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:45.033628 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:45.033632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:45.033635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:45.033659 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:45.035231 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.035669 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.035672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.035673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.035771 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:45.036145 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:45.036148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:45.036149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:45.036321 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:45.036431 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:45.036695 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 06:17:45.036861 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:17:45.038261 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3294
I20260807 06:17:45.051568 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3466
I20260807 06:17:45.062745 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3655
I20260807 06:17:45.080775 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3165
2026-08-07T06:17:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2452 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3869](info): set up 2 sockets
Aug 07 06:17:45 dist-test-slave-68xk krb5kdc[3869](info): commencing operation
krb5kdc: starting...
W20260807 06:17:46.368584 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:46 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab.
Entry for principal oryx/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab.
I20260807 06:17:46.502529 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43159
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab
--principal=oryx/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:43159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:46.617674 3887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:46.617996 3887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:46.618078 3887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:46.622144 3887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:46.622246 3887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:46.622285 3887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:46.622324 3887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:46.622365 3887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:46.628335 3887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:43159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab
--principal=oryx/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:46.629433 3887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:46.630596 3887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:46.639040 3892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:46.639070 3893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:46.639014 3899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:46.639452 3887 server_base.cc:1034] running on GCE node
I20260807 06:17:46.639983 3887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:46.641079 3887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:46.642274 3887 hybrid_clock.cc:648] HybridClock initialized: now 1786083466642244 us; error 55 us; skew 500 ppm
Aug 07 06:17:46 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:46.648160 3887 init.cc:377] Logged in from keytab as oryx/127.26.252.126@KRBTEST.COM (short username oryx)
I20260807 06:17:46.649070 3887 webserver.cc:460] Webserver started at http://127.26.252.126:44789/ using document root <none> and password file <none>
I20260807 06:17:46.649649 3887 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:46.649742 3887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:46.649989 3887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:46.652217 3887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "83d7aa4650814f96815643b1b2bc5921"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "71d6c6bb6334a3448621a76e4bb61446"
server_key_iv: "f9b6c16d22f535b3f7e64c2c096ca64f"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.652789 3887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "83d7aa4650814f96815643b1b2bc5921"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "71d6c6bb6334a3448621a76e4bb61446"
server_key_iv: "f9b6c16d22f535b3f7e64c2c096ca64f"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.656526 3887 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260807 06:17:46.658999 3912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:46.660254 3887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:46.660396 3887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "83d7aa4650814f96815643b1b2bc5921"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "71d6c6bb6334a3448621a76e4bb61446"
server_key_iv: "f9b6c16d22f535b3f7e64c2c096ca64f"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.660506 3887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:46.685434 3887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:46.688465 3887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:46.688673 3887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:46.695921 3887 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:43159
I20260807 06:17:46.695936 3982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:43159 every 8 connection(s)
I20260807 06:17:46.696877 3887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:46.699710 3983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:46.699970 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 3887
I20260807 06:17:46.700106 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:46.700449 27633 external_mini_cluster.cc:1428] Setting key 5bfcec91491e896eac0b8d44619c3e6c
I20260807 06:17:46.707068 3983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Bootstrap starting.
I20260807 06:17:46.709698 3983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Neither blocks nor log segments found. Creating new log.
Aug 07 06:17:46 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:46.710600 3983 log.cc:824] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:46.712950 3983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: No bootstrap required, opened a new log
I20260807 06:17:46.715713 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:46.701900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60778 (local address 127.26.252.126:43159)
0807 06:17:46.702328 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:46.702347 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:46.702392 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:17:46.703207 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:46.703234 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:46.703727 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:46.704116 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:46.704775 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:46.706336 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:46.707245 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:46.707898 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:46.708057 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:46.710573 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:46.710579 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:46.710595 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:46.710629 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:46.712625 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:46.713064 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:46.713070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:46.713075 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:46.713215 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:46.713480 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:46.713483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:46.713485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:46.713969 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:46.714173 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:46.714350 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 06:17:46.714693 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":107,"threads_started":1}
I20260807 06:17:46.717476 3983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } }
I20260807 06:17:46.717736 3983 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:46.717828 3983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83d7aa4650814f96815643b1b2bc5921, State: Initialized, Role: FOLLOWER
I20260807 06:17:46.718261 3983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } }
I20260807 06:17:46.718382 3983 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:46.718487 3983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:46.718585 3983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:46.719468 3983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } }
I20260807 06:17:46.719801 3983 leader_election.cc:302] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83d7aa4650814f96815643b1b2bc5921; no voters:
I20260807 06:17:46.720111 3983 leader_election.cc:288] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:46.720255 3993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:46.720481 3993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 LEADER]: Becoming Leader. State: Replica: 83d7aa4650814f96815643b1b2bc5921, State: Running, Role: LEADER
I20260807 06:17:46.720844 3993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } }
I20260807 06:17:46.721308 3983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:46.722770 3994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } }
I20260807 06:17:46.722817 3995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83d7aa4650814f96815643b1b2bc5921. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } }
I20260807 06:17:46.722929 3995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:46.722930 3994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:46.723428 4004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:46.726512 4004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:46.732074 4004 catalog_manager.cc:1347] Generated new cluster ID: 268aa1fc47b845308a07d7234c97ddbf
I20260807 06:17:46.732136 4004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:46.749629 4004 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:46.750998 4004 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:46.756072 4004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Generated new TSK 0
I20260807 06:17:46.756780 4004 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
I20260807 06:17:46.798370 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:46.920485 4019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:46.920780 4019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:46.920856 4019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:46.925293 4019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:46.925371 4019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:46.925457 4019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:46.930718 4019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:46.931779 4019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:46.932824 4019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:46.943346 4029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:46.943346 4024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:46.943495 4027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:46.943737 4019 server_base.cc:1034] running on GCE node
I20260807 06:17:46.944268 4019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:46.944978 4019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:46.946221 4019 hybrid_clock.cc:648] HybridClock initialized: now 1786083466946225 us; error 48 us; skew 500 ppm
Aug 07 06:17:46 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:46.949240 4019 init.cc:377] Logged in from keytab as oryx/127.26.252.65@KRBTEST.COM (short username oryx)
I20260807 06:17:46.950224 4019 webserver.cc:460] Webserver started at http://127.26.252.65:34143/ using document root <none> and password file <none>
I20260807 06:17:46.950922 4019 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:46.951030 4019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:46.951292 4019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:46.953681 4019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "ddf5e1db3bfad10b5b69d93dd6439114"
server_key_iv: "0233c69d13f3ddeb57b709ab1a14b13a"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.954326 4019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "ddf5e1db3bfad10b5b69d93dd6439114"
server_key_iv: "0233c69d13f3ddeb57b709ab1a14b13a"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.958519 4019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:17:46.961360 4036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:46.962947 4019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:17:46.963140 4019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "ddf5e1db3bfad10b5b69d93dd6439114"
server_key_iv: "0233c69d13f3ddeb57b709ab1a14b13a"
server_key_version: "encryptionkey@0"
I20260807 06:17:46.963286 4019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:46.979586 4019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:46.982609 4019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:46.982816 4019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:46.983439 4019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:46.984295 4019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:46.984380 4019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:46.984472 4019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:46.984524 4019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:46.994048 4019 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:35519
I20260807 06:17:46.994102 4192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:35519 every 8 connection(s)
I20260807 06:17:46.995072 4019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:46.995716 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4019
I20260807 06:17:46.995857 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:46.996156 27633 external_mini_cluster.cc:1428] Setting key f7dfcbf111d0fb217143f317fc69bb3e
Aug 07 06:17:46 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:47.011374 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:46.997152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56113 (local address 127.26.252.126:43159)
0807 06:17:46.997299 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:46.997303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:46.998166 (+ 863us) server_negotiation.cc:407] Connection header received
0807 06:17:46.999727 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:46.999733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:46.999795 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:46.999896 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.001117 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.001672 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.002900 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.003151 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.003279 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.006499 (+ 3220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.006503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.006506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.006534 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.008629 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.009411 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.009415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.009416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.009509 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.009958 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.009961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.009963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.010211 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.010344 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.010998 (+ 654us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.011181 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:47.012328 4195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:46.997571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:56113)
0807 06:17:46.998013 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:46.998056 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:46.999511 (+ 1455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.000055 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.000062 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.000450 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.000956 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.000969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.001811 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.001819 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.002772 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.002782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.003320 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.003325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.003498 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.004125 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.004142 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.006236 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.008787 (+ 2551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.008796 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.008810 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.009282 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.009596 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.009600 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.009602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.009839 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.010367 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.010374 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.010699 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.010913 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.011311 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":122,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:47.013924 4193 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:47.014215 4193 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:47.014937 4193 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
I20260807 06:17:47.016601 3932 ts_manager.cc:194] Registered new tserver with Master: 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:47.017781 3932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:56113
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
I20260807 06:17:47.030165 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:47.143656 4199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:47.143900 4199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:47.143944 4199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:47.148049 4199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:47.148103 4199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:47.148165 4199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:47.153450 4199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:47.154433 4199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:47.155391 4199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:47.165012 4206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.165148 4210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.165179 4207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.165275 4199 server_base.cc:1034] running on GCE node
I20260807 06:17:47.165709 4199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:47.166458 4199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:47.167685 4199 hybrid_clock.cc:648] HybridClock initialized: now 1786083467167647 us; error 47 us; skew 500 ppm
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:47.170715 4199 init.cc:377] Logged in from keytab as oryx/127.26.252.66@KRBTEST.COM (short username oryx)
I20260807 06:17:47.171630 4199 webserver.cc:460] Webserver started at http://127.26.252.66:33681/ using document root <none> and password file <none>
I20260807 06:17:47.172237 4199 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.172340 4199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:47.172592 4199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:47.174834 4199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "9156e738d876b31c7e38e3ea011c307e"
server_key_iv: "57674c56fb571ea84a986c6d0b0eb8dd"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.175429 4199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "9156e738d876b31c7e38e3ea011c307e"
server_key_iv: "57674c56fb571ea84a986c6d0b0eb8dd"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.179316 4199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:17:47.181969 4218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.183334 4199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:47.183490 4199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "9156e738d876b31c7e38e3ea011c307e"
server_key_iv: "57674c56fb571ea84a986c6d0b0eb8dd"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.183604 4199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.196175 4199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:47.199438 4199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:47.199663 4199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:47.200316 4199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:47.201237 4199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:47.201318 4199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.201398 4199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:47.201448 4199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.211416 4199 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:43353
I20260807 06:17:47.211457 4378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:43353 every 8 connection(s)
I20260807 06:17:47.212371 4199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:47.217099 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4199
I20260807 06:17:47.217237 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:47.217497 27633 external_mini_cluster.cc:1428] Setting key bb7ccd12f25c99365412c9c02b361a54
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:47.227587 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.214185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:49621 (local address 127.26.252.126:43159)
0807 06:17:47.214355 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.214359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.215248 (+ 889us) server_negotiation.cc:407] Connection header received
0807 06:17:47.216648 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.216652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.216712 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.216827 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.218110 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.218794 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.220525 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.220747 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.220832 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.223796 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.223800 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.223803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.223829 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.225365 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.225924 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.225928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.225929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.226014 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.226373 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.226377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.226379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.226596 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.226718 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.227268 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.227404 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:17:47.228353 4384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.214636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:49621)
0807 06:17:47.215103 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.215144 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.216437 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.217013 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.217020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.217437 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.217945 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.217958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.218951 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.218954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.220392 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.220406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.220904 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.220911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.221140 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.221852 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.221870 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.223626 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.225507 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.225513 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.225527 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.225807 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.226110 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.226114 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.226116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.226270 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.226717 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.226724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.226966 (+ 242us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.227177 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.227474 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for oryx/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:47.229524 4381 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:47.229799 4381 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:47.230276 4381 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.67@KRBTEST.COM" created.
I20260807 06:17:47.231472 3932 ts_manager.cc:194] Registered new tserver with Master: bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353)
I20260807 06:17:47.232067 3932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:49621
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
I20260807 06:17:47.249192 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:47.362391 4387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:47.362704 4387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:47.362771 4387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:47.366904 4387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:47.366954 4387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:47.367012 4387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:47.372350 4387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:43159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:47.373315 4387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:47.374302 4387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:47.383800 4397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.383785 4393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.383821 4394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.384443 4387 server_base.cc:1034] running on GCE node
I20260807 06:17:47.384831 4387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:47.385479 4387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:47.386693 4387 hybrid_clock.cc:648] HybridClock initialized: now 1786083467386678 us; error 27 us; skew 500 ppm
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:47.389516 4387 init.cc:377] Logged in from keytab as oryx/127.26.252.67@KRBTEST.COM (short username oryx)
I20260807 06:17:47.390488 4387 webserver.cc:460] Webserver started at http://127.26.252.67:45423/ using document root <none> and password file <none>
I20260807 06:17:47.391060 4387 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.391153 4387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:47.391388 4387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:47.393396 4387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "ad494a1b227b4cb590b823660a5bdf24"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "6b93459f6d2adfe9a3aa61d67fa25c24"
server_key_iv: "8bc12d60997cf5d1fe9c463a70d0a8c4"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.393989 4387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "ad494a1b227b4cb590b823660a5bdf24"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "6b93459f6d2adfe9a3aa61d67fa25c24"
server_key_iv: "8bc12d60997cf5d1fe9c463a70d0a8c4"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.397876 4387 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:17:47.400393 4406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.401695 4387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:47.401841 4387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "ad494a1b227b4cb590b823660a5bdf24"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "6b93459f6d2adfe9a3aa61d67fa25c24"
server_key_iv: "8bc12d60997cf5d1fe9c463a70d0a8c4"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.401954 4387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.413164 4387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:47.416308 4387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:47.416517 4387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:47.417126 4387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:47.417963 4387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:47.418036 4387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.418108 4387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:47.418154 4387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.428012 4387 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:46265
I20260807 06:17:47.428042 4574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:46265 every 8 connection(s)
I20260807 06:17:47.428895 4387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:47.436404 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4387
I20260807 06:17:47.436532 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:47.436877 27633 external_mini_cluster.cc:1428] Setting key 41b96fb54700f5c389804bfc5588760e
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:47.443840 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.430869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:35933 (local address 127.26.252.126:43159)
0807 06:17:47.431046 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.431050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.431907 (+ 857us) server_negotiation.cc:407] Connection header received
0807 06:17:47.433411 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.433413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.433460 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.433535 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.434841 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.435388 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.436981 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.437211 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.437302 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.440468 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.440471 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.440473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.440496 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.441946 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.442513 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.442516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.442517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.442590 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.442926 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.442928 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.442929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.443090 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.443163 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.443636 (+ 473us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.443724 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:17:47.444746 4579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.431249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:35933)
0807 06:17:47.431742 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.431788 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.433205 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.433736 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.433742 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.434117 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.434703 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.434718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.435513 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.435516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.436836 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.436848 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.437388 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.437395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.437626 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.438377 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.438400 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.440317 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.442059 (+ 1742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.442063 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.442075 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.442355 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.442683 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.442685 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.442687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.442833 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.443186 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.443191 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.443419 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.443575 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.443835 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":123,"threads_started":1}
I20260807 06:17:47.445950 4576 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:47.446190 4576 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:47.446733 4576 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
I20260807 06:17:47.447781 3932 ts_manager.cc:194] Registered new tserver with Master: ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67:46265)
I20260807 06:17:47.448359 3932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:35933
I20260807 06:17:47.451314 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.252.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.125.keytab.
Entry for principal oryx/127.26.252.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.125.keytab.
I20260807 06:17:47.481992 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:40451
--webserver_interface=127.26.252.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.125.keytab
--principal=oryx/127.26.252.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:43159,127.26.252.125:40451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:47.597519 4582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:47.597833 4582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:47.597874 4582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:47.601791 4582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:47.601850 4582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:47.601869 4582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:47.601886 4582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:47.601902 4582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:47.607300 4582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:43159,127.26.252.125:40451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.125.keytab
--principal=oryx/127.26.252.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:40451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.252.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
W20260807 06:17:47.607498 4582 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.252.126:43159,127.26.252.125:40451'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 06:17:47.608420 4582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:47.609390 4582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:47.618085 4588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.618093 4587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.618463 4590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.618391 4582 server_base.cc:1034] running on GCE node
I20260807 06:17:47.618999 4582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:47.620105 4582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:47.621312 4582 hybrid_clock.cc:648] HybridClock initialized: now 1786083467621290 us; error 30 us; skew 500 ppm
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:47.624619 4582 init.cc:377] Logged in from keytab as oryx/127.26.252.125@KRBTEST.COM (short username oryx)
I20260807 06:17:47.625677 4582 webserver.cc:460] Webserver started at http://127.26.252.125:35031/ using document root <none> and password file <none>
I20260807 06:17:47.626286 4582 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.626386 4582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:47.626673 4582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:47.628778 4582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/instance:
uuid: "69c8376eea494bf19620ba745263cd45"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "e7d9ac2b629e712ff90d053745402e4d"
server_key_iv: "6fa8f8a15f57124aea8970f01cc081ae"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.629355 4582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal/instance:
uuid: "69c8376eea494bf19620ba745263cd45"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "e7d9ac2b629e712ff90d053745402e4d"
server_key_iv: "6fa8f8a15f57124aea8970f01cc081ae"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.633051 4582 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:47.635550 4599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.636711 4582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:47.636849 4582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "69c8376eea494bf19620ba745263cd45"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "e7d9ac2b629e712ff90d053745402e4d"
server_key_iv: "6fa8f8a15f57124aea8970f01cc081ae"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.636955 4582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.646957 4582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:47.649622 4582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:47.649817 4582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:47.656945 4582 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.125:40451
I20260807 06:17:47.657230 4679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.125:40451 every 8 connection(s)
I20260807 06:17:47.657891 4582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
I20260807 06:17:47.658703 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4582
I20260807 06:17:47.661070 4680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:47.665581 4680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.125@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:47.675486 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.660333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.26.252.125:40451)
0807 06:17:47.660764 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.660784 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.660826 (+ 42us) server_negotiation.cc:407] Connection header received
0807 06:17:47.661678 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.661700 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.662095 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.662479 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.663226 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.664779 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.666116 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.666698 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.666900 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.670132 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.670139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.670148 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.670176 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.672273 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.672774 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.672787 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.672792 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.672904 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.673231 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.673236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.673238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.673661 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.673899 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.674396 (+ 497us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.674712 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":128,"threads_started":1}
I20260807 06:17:47.676906 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.667266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60788 (local address 127.26.252.126:43159)
0807 06:17:47.667426 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.667429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.668142 (+ 713us) server_negotiation.cc:407] Connection header received
0807 06:17:47.668442 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.668448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.668522 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.668613 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.669363 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.669929 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.670920 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.671144 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.671259 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.673420 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.673424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.673425 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.673449 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.674991 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.675527 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.675531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.675533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.675637 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.675939 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.675943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.675945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.676185 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.676304 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.676679 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.676787 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:17:47.676927 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.667574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60788)
0807 06:17:47.667958 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.667999 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.668208 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.668722 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.668727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.669081 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.669217 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.669223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.670068 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.670072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.670793 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.670803 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.671268 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.671272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.671388 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.671860 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.671872 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.673271 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.675159 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.675169 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.675174 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.675414 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.675739 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.675741 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.675743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.675832 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.676304 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.676312 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.676428 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.676577 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.676741 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":137,"threads_started":1}
I20260807 06:17:47.678483 4680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.125@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
I20260807 06:17:47.686893 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.678917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33784)
0807 06:17:47.679032 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.679046 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.679196 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.679460 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.679462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.679611 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.679760 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.679768 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.680914 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.680917 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.681670 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.681704 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.682153 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.682162 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.682243 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.682705 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.682717 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.683918 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.685598 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.685600 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.685602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.685801 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.686035 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.686037 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.686038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.686108 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.686509 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.686511 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.686582 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.686665 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.686765 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 06:17:47.687008 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.679056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.26.252.125:40451)
0807 06:17:47.679172 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.679176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.679189 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:47.679315 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.679317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.679351 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.679420 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.679926 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.680791 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.681825 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.682044 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.682121 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.684041 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.684044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.684046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.684066 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.685484 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.685884 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.685886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.685887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.685956 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.686185 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.686187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.686188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.686360 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.686500 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.686723 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.686836 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:17:47.689713 4680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Bootstrap starting.
I20260807 06:17:47.692086 4680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:47.692812 4680 log.cc:824] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:47.694754 4680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: No bootstrap required, opened a new log
I20260807 06:17:47.697732 4680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } }
I20260807 06:17:47.697921 4680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:47.697988 4680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69c8376eea494bf19620ba745263cd45, State: Initialized, Role: FOLLOWER
I20260807 06:17:47.698395 4680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } }
I20260807 06:17:47.698901 4686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } } }
I20260807 06:17:47.699023 4686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:47.699656 4680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 06:17:47.704641 4700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:17:47.704746 4700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:17:47.706691 4582 master_runner.cc:428] Detected that this master 69c8376eea494bf19620ba745263cd45 is joining an existing cluster
I20260807 06:17:47.706748 4582 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.252.125:40451
I20260807 06:17:47.717615 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.708915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60800 (local address 127.26.252.126:43159)
0807 06:17:47.709036 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.709041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.709346 (+ 305us) server_negotiation.cc:407] Connection header received
0807 06:17:47.709464 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.709467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.709514 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.709595 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.710145 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.710981 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.712037 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.712369 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.712457 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.713862 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.713865 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.713868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.713896 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.715701 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.716275 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.716282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.716287 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.716389 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.716701 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.716705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.716707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.716896 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.717008 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.717338 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.717462 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:17:47.717643 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.708828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60800)
0807 06:17:47.709240 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.709266 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.709373 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.709634 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.709637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.709873 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.710014 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.710022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.711113 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.711118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.711906 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.711915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.712601 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.712605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.712693 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.713233 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.713245 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.713721 (+ 476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.715833 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.715836 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.715838 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.716152 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.716504 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.716507 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.716509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.716602 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.716998 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.717001 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.717117 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.717249 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.717393 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
I20260807 06:17:47.718730 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.710464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33796)
0807 06:17:47.710879 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.710893 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.710991 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.711272 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.711275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.711513 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.711637 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.711645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.712574 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.712578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.713489 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.713499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.714032 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.714035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.714171 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.714698 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.714714 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.715174 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.717097 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.717100 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.717101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.717372 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.717637 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.717653 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.717658 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.717741 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.718160 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.718162 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.718241 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.718358 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.718519 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":19,"thread_start_us":218,"threads_started":1}
I20260807 06:17:47.718775 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.710519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.26.252.125:40451)
0807 06:17:47.710607 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.710611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.710986 (+ 375us) server_negotiation.cc:407] Connection header received
0807 06:17:47.711081 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.711086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.711132 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.711224 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.711764 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.712451 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.713600 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.713923 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.714031 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.715306 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.715309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.715312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.715333 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.717005 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.717471 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.717475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.717476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.717546 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.717840 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.717846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.717852 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.718028 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.718086 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.718473 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.718589 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":29}
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.126@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
I20260807 06:17:47.733407 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.723331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33804)
0807 06:17:47.723705 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.723749 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.723907 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.724249 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.724255 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.724687 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.724791 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.724798 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.725519 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.725523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.726214 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.726224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.726770 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.726774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.726897 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.727414 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.727425 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.729413 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.731451 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.731461 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.731468 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.731767 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.732098 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.732101 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.732103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.732201 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.732714 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.732721 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.732854 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.733010 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.733207 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":116,"threads_started":1}
I20260807 06:17:47.733475 4683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.723377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33804 (local address 127.26.252.125:40451)
0807 06:17:47.723492 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.723496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.723828 (+ 332us) server_negotiation.cc:407] Connection header received
0807 06:17:47.724036 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.724039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.724087 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.724200 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.724908 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.725408 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.726350 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.726650 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.726756 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.729553 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.729557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.729560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.729585 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.731325 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.731881 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.731888 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.731892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.731989 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.732303 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.732308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.732310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.732586 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.732705 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.733100 (+ 395us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.733242 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:17:47.735567 3932 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.252.125:40451: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "69c8376eea494bf19620ba745263cd45"
member_type: NON_VOTER
last_known_addr {
host: "127.26.252.125"
port: 40451
}
attrs {
promote: true
}
}
dest_uuid: "83d7aa4650814f96815643b1b2bc5921"
cas_config_opid_index: -1
I20260807 06:17:47.736485 3932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } }
I20260807 06:17:47.738511 4715 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 69c8376eea494bf19620ba745263cd45 (127.26.252.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } }
I20260807 06:17:47.739512 4645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:47.740317 4715 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.252.125:40451
I20260807 06:17:47.740711 4716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } }
I20260807 06:17:47.740983 4716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:47.741124 4645 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 06:17:47.741560 4582 master.cc:537] Master@127.26.252.125:40451 shutting down...
I20260807 06:17:47.742303 4716 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
WARNING: no policy specified for oryx/127.26.252.124@KRBTEST.COM; defaulting to no policy
W20260807 06:17:47.745375 3914 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 06:17:47.746446 3914 consensus_peers.cc:487] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 -> Peer 69c8376eea494bf19620ba745263cd45 (127.26.252.125:40451): Couldn't send request to peer 69c8376eea494bf19620ba745263cd45. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 06:17:47.746764 4582 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Raft consensus shutting down.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.124@KRBTEST.COM" created.
I20260807 06:17:47.747064 4582 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:47.747189 4582 tablet_replica.cc:330] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: stopping tablet replica
I20260807 06:17:47.764107 4582 master.cc:552] Master@127.26.252.125:40451 shutdown complete.
I20260807 06:17:47.764204 4582 master_runner.cc:305] Clearing existing system tablet
I20260807 06:17:47.764518 4582 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.764601 4582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.124.keytab.
Entry for principal oryx/127.26.252.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.124.keytab.
I20260807 06:17:47.766237 4582 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:47.767055 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:46601
--webserver_interface=127.26.252.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.124.keytab
--principal=oryx/127.26.252.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:17:47.767316 4722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.767707 4582 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.767887 4582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 06:17:47.767933 4582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "69c8376eea494bf19620ba745263cd45"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "e7d9ac2b629e712ff90d053745402e4d"
server_key_iv: "6fa8f8a15f57124aea8970f01cc081ae"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.770453 4582 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:47.774060 4582 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:17:47.774195 4582 log.cc:1196] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 06:17:47.774642 4582 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Deleting consensus metadata
I20260807 06:17:47.774899 4582 master_runner.cc:315] Copying system tablet from 127.26.252.126:43159
I20260807 06:17:47.776778 4582 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: tablet copy: Beginning tablet copy session from remote peer at address 127.26.252.126:43159
I20260807 06:17:47.787940 4732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.777556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60808)
0807 06:17:47.778662 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.778678 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.778816 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.779195 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.779198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.779437 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.779572 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.779580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.780910 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.780914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.781836 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.781847 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.782586 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.782592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.782716 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.783348 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.783363 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.783808 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.786009 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.786012 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.786015 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.786279 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.786653 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.786657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.786660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.786764 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.787226 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.787229 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.787348 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.787527 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.787693 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":109,"threads_started":1}
I20260807 06:17:47.787951 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.777718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60808 (local address 127.26.252.126:43159)
0807 06:17:47.777921 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.777927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.778796 (+ 869us) server_negotiation.cc:407] Connection header received
0807 06:17:47.778931 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.778938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.779016 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.779143 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.779724 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.780758 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.781981 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.782461 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.782576 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.783968 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.783972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.783976 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.784008 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.785885 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.786388 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.786392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.786394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.786522 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.786885 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.786889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.786891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.787123 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.787221 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.787603 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.787789 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:17:47.788928 3958 tablet_copy_service.cc:140] P 83d7aa4650814f96815643b1b2bc5921: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 69c8376eea494bf19620ba745263cd45 ({username='oryx', principal='oryx/127.26.252.125@KRBTEST.COM'} at 127.0.0.1:60808)
I20260807 06:17:47.789130 3958 tablet_copy_service.cc:161] P 83d7aa4650814f96815643b1b2bc5921: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 69c8376eea494bf19620ba745263cd45 at {username='oryx', principal='oryx/127.26.252.125@KRBTEST.COM'} at 127.0.0.1:60808: session id = 69c8376eea494bf19620ba745263cd45-00000000000000000000000000000000
I20260807 06:17:47.791124 3958 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:17:47.793279 4582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:17:47.796099 4582 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: tablet copy: Starting download of 0 data blocks...
I20260807 06:17:47.796327 4582 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: tablet copy: Starting download of 1 WAL segments...
I20260807 06:17:47.798338 4582 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:17:47.800294 3958 tablet_copy_service.cc:342] P 83d7aa4650814f96815643b1b2bc5921: Request end of tablet copy session 69c8376eea494bf19620ba745263cd45-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.252.125@KRBTEST.COM'} at 127.0.0.1:60808
I20260807 06:17:47.800407 3958 tablet_copy_service.cc:433] P 83d7aa4650814f96815643b1b2bc5921: ending tablet copy session 69c8376eea494bf19620ba745263cd45-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 69c8376eea494bf19620ba745263cd45
I20260807 06:17:47.809185 4582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:47.810998 4734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.811061 4739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.811702 4736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.815323 4582 server_base.cc:1034] running on GCE node
I20260807 06:17:47.815521 4582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:47.815886 4582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:47.817121 4582 hybrid_clock.cc:648] HybridClock initialized: now 1786083467817109 us; error 30 us; skew 500 ppm
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:47.818966 4582 init.cc:377] Logged in from keytab as oryx/127.26.252.125@KRBTEST.COM (short username oryx)
I20260807 06:17:47.819429 4582 webserver.cc:460] Webserver started at http://127.26.252.125:45513/ using document root <none> and password file <none>
I20260807 06:17:47.819633 4582 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.819679 4582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:47.821069 4582 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:47.822275 4749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.822579 4582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:47.822693 4582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "69c8376eea494bf19620ba745263cd45"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "e7d9ac2b629e712ff90d053745402e4d"
server_key_iv: "6fa8f8a15f57124aea8970f01cc081ae"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.822829 4582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.842885 4582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:47.845358 4582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:47.851074 4582 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.125:40451
I20260807 06:17:47.851114 4822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.125:40451 every 8 connection(s)
I20260807 06:17:47.851774 4582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
I20260807 06:17:47.853848 4823 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:17:47.855234 4823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Bootstrap starting.
I20260807 06:17:47.866992 4823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:17:47.867326 4823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: Bootstrap complete.
I20260807 06:17:47.868017 4823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } }
I20260807 06:17:47.868178 4823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 69c8376eea494bf19620ba745263cd45, State: Initialized, Role: LEARNER
I20260807 06:17:47.868319 4823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } }
I20260807 06:17:47.868745 4826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } }
I20260807 06:17:47.868875 4823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:47.868964 4826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:17:47.872479 4844 catalog_manager.cc:1259] Loaded cluster ID: 268aa1fc47b845308a07d7234c97ddbf
I20260807 06:17:47.872545 4844 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: loading cluster ID for follower catalog manager: success
I20260807 06:17:47.874866 4844 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: acquiring CA information for follower catalog manager: success
I20260807 06:17:47.876185 4844 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 06:17:47.914995 4723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:47.915284 4723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:47.915361 4723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:47.919315 4723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:47.919401 4723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:47.919440 4723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:47.919499 4723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:47.919551 4723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:47.925145 4723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.124.keytab
--principal=oryx/127.26.252.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:46601
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.252.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:47.926201 4723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:47.927248 4723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:47.935467 4853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:47.935500 4850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.935752 4723 server_base.cc:1034] running on GCE node
W20260807 06:17:47.935500 4849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:47.936343 4723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:47.937465 4723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:47.938684 4723 hybrid_clock.cc:648] HybridClock initialized: now 1786083467938650 us; error 33 us; skew 500 ppm
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:47.941604 4723 init.cc:377] Logged in from keytab as oryx/127.26.252.124@KRBTEST.COM (short username oryx)
I20260807 06:17:47.942637 4723 webserver.cc:460] Webserver started at http://127.26.252.124:36299/ using document root <none> and password file <none>
I20260807 06:17:47.943250 4723 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:47.943317 4723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:47.943567 4723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:47.945783 4723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/instance:
uuid: "ed249c1cbcf64e68a4277c034eba17ef"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "b8fdc107679fc7e006e3bed1d9de4079"
server_key_iv: "efb2607f56e95110d3142c03760a1ecb"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.946362 4723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal/instance:
uuid: "ed249c1cbcf64e68a4277c034eba17ef"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "b8fdc107679fc7e006e3bed1d9de4079"
server_key_iv: "efb2607f56e95110d3142c03760a1ecb"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.950125 4723 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:17:47.952629 4862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:47.953836 4723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:47.953979 4723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "ed249c1cbcf64e68a4277c034eba17ef"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "b8fdc107679fc7e006e3bed1d9de4079"
server_key_iv: "efb2607f56e95110d3142c03760a1ecb"
server_key_version: "encryptionkey@0"
I20260807 06:17:47.954089 4723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:47.967439 4723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:47.970659 4723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:47.970902 4723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:47.977839 4723 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.124:46601
I20260807 06:17:47.978135 4934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.124:46601 every 8 connection(s)
I20260807 06:17:47.978940 4723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
I20260807 06:17:47.981701 4935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:47.985550 4935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:17:47.985980 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4723
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.124@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
Aug 07 06:17:47 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
I20260807 06:17:47.999213 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.987737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60822 (local address 127.26.252.126:43159)
0807 06:17:47.987895 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.987899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.988325 (+ 426us) server_negotiation.cc:407] Connection header received
0807 06:17:47.989118 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.989120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.989171 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.989248 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.990232 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.990837 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.991912 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.992134 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.992243 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.994993 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.995000 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.995004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.995036 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.996744 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.997412 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.997416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.997418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.997510 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.997887 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.997891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.997893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.998148 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.998275 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:47.998905 (+ 630us) server_negotiation.cc:299] Negotiation successful
0807 06:17:47.999042 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:17:47.999997 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.987565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60822)
0807 06:17:47.988166 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:47.988213 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:47.988888 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:47.989332 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:47.989337 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:47.989794 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:47.990061 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.990081 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.990963 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.990966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.991786 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:47.991795 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.992290 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.992294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:47.992441 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.993041 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:47.993066 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:47.994810 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:47.996863 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.996874 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.996888 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.997291 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.997605 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:47.997609 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:47.997611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:47.997780 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:47.998283 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:47.998288 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:47.998622 (+ 334us) client_negotiation.cc:769] Sending connection context
0807 06:17:47.998832 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 06:17:47.999147 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"spinlock_wait_cycles":65792,"thread_start_us":204,"threads_started":1}
I20260807 06:17:48.000412 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:47.987552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52064 (local address 127.26.252.124:46601)
0807 06:17:47.987998 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:47.988018 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:47.988059 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:17:47.988888 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:47.988910 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:47.989153 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:47.989338 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:47.990094 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.991132 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.992004 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:47.992372 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:47.992521 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:47.995888 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:47.995896 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:47.995911 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:47.995943 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:47.997949 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.998503 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.998509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.998510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.998596 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:47.998938 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:47.998941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:47.998943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:47.999220 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:47.999984 (+ 764us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.000069 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.000222 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":312,"thread_start_us":165,"threads_started":1}
I20260807 06:17:48.002025 4935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.124@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
I20260807 06:17:48.010143 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.002562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33806)
0807 06:17:48.002682 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.002698 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.002777 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.003229 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.003231 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.003405 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.003496 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.003501 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.004403 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.004408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.005029 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.005038 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.005538 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.005541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.005641 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.006072 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.006083 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.007357 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.008902 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.008904 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.008905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.009116 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.009380 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.009382 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.009383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.009459 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.009793 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.009795 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.009867 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.009947 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.010041 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 06:17:48.010238 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.002733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.26.252.125:40451)
0807 06:17:48.003021 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.003024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.003036 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:17:48.003072 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.003074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.003111 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.003212 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.003617 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.004293 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.005161 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.005405 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.005541 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.007484 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.007487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.007489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.007513 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.008804 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.009223 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.009226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.009227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.009300 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.009537 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.009539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.009540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.009710 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.009799 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.010003 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.010098 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":112,"threads_started":1}
I20260807 06:17:48.010972 4935 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083467, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.124@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
I20260807 06:17:48.018505 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.011453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52080)
0807 06:17:48.011570 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.011584 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.011649 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.011815 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.011817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.011933 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.011996 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.011999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.012661 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.012664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.013141 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.013148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.013586 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.013588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.013642 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.013998 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.014008 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.015117 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.017294 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.017296 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.017297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.017473 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.017708 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.017710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.017711 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.017794 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.018101 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.018103 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.018170 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.018246 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.018336 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 06:17:48.018707 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.011544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52080 (local address 127.26.252.124:46601)
0807 06:17:48.011654 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.011657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.011683 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:17:48.011711 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.011712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.011745 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.011801 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.012081 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.012558 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.013261 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.013487 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.013572 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.015235 (+ 1663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.015238 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.015240 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.015261 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.017187 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.017556 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.017558 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.017559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.017628 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.017870 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.017872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.017873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.018022 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.018096 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.018302 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.018394 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:17:48.020061 4193 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
I20260807 06:17:48.021871 4935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Bootstrap starting.
I20260807 06:17:48.024449 4935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:48.025220 4935 log.cc:824] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:48.027197 4935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: No bootstrap required, opened a new log
I20260807 06:17:48.030130 4935 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } }
I20260807 06:17:48.030334 4935 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:48.030431 4935 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed249c1cbcf64e68a4277c034eba17ef, State: Initialized, Role: FOLLOWER
I20260807 06:17:48.030838 4935 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } }
I20260807 06:17:48.031308 4947 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } } }
I20260807 06:17:48.031446 4947 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:48.032054 4935 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: configured and running, proceeding with master startup.
W20260807 06:17:48.037021 4959 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:17:48.037151 4959 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:17:48.040546 4723 master_runner.cc:428] Detected that this master ed249c1cbcf64e68a4277c034eba17ef is joining an existing cluster
I20260807 06:17:48.040612 4723 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.252.124:46601
I20260807 06:17:48.053622 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4019
I20260807 06:17:48.066977 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.26.252.124:46601)
0807 06:17:48.044005 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.044009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.044235 (+ 226us) server_negotiation.cc:407] Connection header received
0807 06:17:48.044413 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.044421 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.044454 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.044539 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.045084 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.045881 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047371 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.047690 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.048103 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.049808 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.049810 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.049812 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.049833 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.051306 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.063607 (+ 12301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.063615 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.063619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.063709 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.065121 (+ 1412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.065126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.065128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.065399 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.065481 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.066646 (+ 1165us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.066782 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40,"spinlock_wait_cycles":1792}
I20260807 06:17:48.067617 4970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52090)
0807 06:17:48.044166 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.044178 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.044284 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.044552 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.044554 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.044805 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.044960 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.044969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.046022 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.046025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.047245 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.047277 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.048211 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.048213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.048274 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.049079 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.049095 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.049455 (+ 360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.051430 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.051433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.051435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.063464 (+ 12029us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.064345 (+ 881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.064347 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.064349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.064447 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.065555 (+ 1108us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.065558 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.065667 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.067277 (+ 1610us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.067418 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"mutex_wait_us":59,"thread_start_us":89,"threads_started":1}
I20260807 06:17:48.068197 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60832 (local address 127.26.252.126:43159)
0807 06:17:48.043377 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.043383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.043637 (+ 254us) server_negotiation.cc:407] Connection header received
0807 06:17:48.043856 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.043860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.043913 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.043971 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.044690 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.045553 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.046831 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.047175 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047252 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.048726 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.048730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.048732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.048755 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.050455 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.064574 (+ 14119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.064578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.064582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.064702 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.065833 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.065839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.065841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.066120 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.066207 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.067893 (+ 1686us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.068026 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:17:48.068691 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.26.252.125:40451)
0807 06:17:48.043360 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.043364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.043643 (+ 279us) server_negotiation.cc:407] Connection header received
0807 06:17:48.043873 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.043877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.043935 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.043995 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.045079 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.045881 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047179 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.047584 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047659 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.064348 (+ 16689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.064352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.064356 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.064389 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.066239 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.066764 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.066768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.066769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.066855 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.067518 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.067522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.067524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.067793 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.067870 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.068377 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.068523 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:17:48.068918 4968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60832)
0807 06:17:48.043553 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.043569 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.043710 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.044121 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.044124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.044387 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.044549 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.044557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.045713 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.045717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.046676 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.046687 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.047424 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.047516 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.048060 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.048077 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.048579 (+ 502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.050581 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.050584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.050588 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.063161 (+ 12573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.064851 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.064855 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.064858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.064963 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.066289 (+ 1326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.066295 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.066406 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.068455 (+ 2049us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.068594 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":134,"threads_started":1}
I20260807 06:17:48.069558 4969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.043129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33814)
0807 06:17:48.043558 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.043573 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.043724 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.044171 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.044174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.044748 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.044893 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.044901 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.046022 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.046025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.047029 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.047040 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.047824 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.047828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.047936 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.063815 (+ 15879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.063832 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.064165 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.066359 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.066361 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.066363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.066647 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.066971 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.066973 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.066975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.067124 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.068087 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.068090 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.068177 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.069330 (+ 1153us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.069440 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":7,"spinlock_wait_cycles":1408,"thread_start_us":100,"threads_started":1}
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083466, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.126@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
I20260807 06:17:48.087743 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.077146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52104)
0807 06:17:48.077391 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.077412 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.077532 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.077880 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.077887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.078174 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.078337 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.078352 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.079504 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.079511 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.080552 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.080568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.081230 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.081237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.081378 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.081908 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.081929 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.083795 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.085839 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.085845 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.085850 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.086134 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.086503 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.086509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.086514 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.086641 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.087083 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.087086 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.087212 (+ 126us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.087317 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.087495 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260807 06:17:48.088130 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:35519
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:43159
--webserver_port=34143
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:17:48.088341 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.077198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.26.252.124:46601)
0807 06:17:48.077319 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.077349 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.077497 (+ 148us) server_negotiation.cc:407] Connection header received
0807 06:17:48.077680 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.077686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.077745 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.077824 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.078527 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.079293 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.080700 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.081044 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.081197 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.083943 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.083947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.083950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.083976 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.085705 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.086243 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.086246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.086248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.086338 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.086757 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.086761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.086763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.086973 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.087071 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.087782 (+ 711us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.088039 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:17:48.089644 3932 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.252.124:46601: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef"
member_type: NON_VOTER
last_known_addr {
host: "127.26.252.124"
port: 46601
}
attrs {
promote: true
}
}
dest_uuid: "83d7aa4650814f96815643b1b2bc5921"
cas_config_opid_index: 5
I20260807 06:17:48.090451 3932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } }
I20260807 06:17:48.091665 4715 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.092424 4893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:48.093135 4715 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.252.124:46601
I20260807 06:17:48.093299 4715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.093386 4715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.093604 4893 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 06:17:48.094249 4716 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:48.094328 4723 master.cc:537] Master@127.26.252.124:46601 shutting down...
W20260807 06:17:48.096326 3913 consensus_peers.cc:487] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 -> Peer ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124:46601): Couldn't send request to peer ed249c1cbcf64e68a4277c034eba17ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 06:17:48.100416 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.093626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33820 (local address 127.26.252.125:40451)
0807 06:17:48.093775 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.093780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.093797 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:17:48.093849 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.093852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.093917 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.094022 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.096583 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.097345 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.098856 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.099481 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.099589 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.099756 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.100210 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.100291 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:17:48.100805 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.091888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33820)
0807 06:17:48.092006 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.092023 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.092098 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.094165 (+ 2067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.094169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.094188 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.096431 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.096443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.097509 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.097516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.098705 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.098723 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.099866 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.099869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.099999 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.100063 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.100573 (+ 510us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.100670 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 06:17:48.101325 4784 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 LEARNER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 06:17:48.101984 4716 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 06:17:48.102515 4723 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:48.102814 4723 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:48.102910 4723 tablet_replica.cc:330] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: stopping tablet replica
I20260807 06:17:48.104388 4784 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.106511 4826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83d7aa4650814f96815643b1b2bc5921. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.106618 4826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:17:48.106684 4826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: NON_VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: true } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.106745 4826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:17:48.107470 4716 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: attempting to promote NON_VOTER 69c8376eea494bf19620ba745263cd45 to VOTER
I20260807 06:17:48.107904 4716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } }
I20260807 06:17:48.109438 4782 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 LEARNER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 06:17:48.110838 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.110544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52106)
0807 06:17:48.110689 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.110764 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:46601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260807 06:17:48.111016 3913 consensus_peers.cc:487] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 -> Peer ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124:46601): Couldn't send request to peer ed249c1cbcf64e68a4277c034eba17ef. Status: Network error: Client connection negotiation failed: client connection to 127.26.252.124:46601: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 06:17:48.111341 4715 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 06:17:48.112896 4716 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 69c8376eea494bf19620ba745263cd45 (127.26.252.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.114387 4716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.114506 4716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.115124 4715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.115221 4715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.115839 4782 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 69c8376eea494bf19620ba745263cd45 (127.26.252.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.117509 4974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.117645 4974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:48.121877 4723 master.cc:552] Master@127.26.252.124:46601 shutdown complete.
I20260807 06:17:48.121934 4723 master_runner.cc:305] Clearing existing system tablet
I20260807 06:17:48.122181 4723 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:48.122239 4723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:48.123646 4723 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:48.124620 4980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.124899 4723 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:48.125028 4723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:48.125075 4723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "ed249c1cbcf64e68a4277c034eba17ef"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "b8fdc107679fc7e006e3bed1d9de4079"
server_key_iv: "efb2607f56e95110d3142c03760a1ecb"
server_key_version: "encryptionkey@0"
I20260807 06:17:48.127197 4723 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:48.130046 4723 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:17:48.130141 4723 log.cc:1196] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 06:17:48.130393 4723 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Deleting consensus metadata
I20260807 06:17:48.130585 4723 master_runner.cc:315] Copying system tablet from 127.26.252.126:43159
I20260807 06:17:48.131752 4723 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: tablet copy: Beginning tablet copy session from remote peer at address 127.26.252.126:43159
I20260807 06:17:48.141294 4986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.132262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:60838)
0807 06:17:48.132577 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.132592 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.132725 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.133070 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.133075 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.133327 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.133457 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.133465 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.134640 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.134644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.135653 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.135665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.136311 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.136315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.136417 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.137035 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.137051 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.137481 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.139564 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.139567 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.139570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.139838 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.140145 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.140148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.140150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.140245 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.140730 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.140733 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.140834 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.140945 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.141084 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":94,"threads_started":1}
I20260807 06:17:48.141320 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.132362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60838 (local address 127.26.252.126:43159)
0807 06:17:48.132506 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.132512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.132676 (+ 164us) server_negotiation.cc:407] Connection header received
0807 06:17:48.132874 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.132878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.132933 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.133032 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.133590 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.134499 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.135829 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.136174 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.136293 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.137635 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.137639 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.137641 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.137669 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.139441 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.139947 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.139950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.139952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.140041 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.140396 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.140401 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.140403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.140621 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.140727 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.141018 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.141132 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:17:48.142124 3958 tablet_copy_service.cc:140] P 83d7aa4650814f96815643b1b2bc5921: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ed249c1cbcf64e68a4277c034eba17ef ({username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:60838)
I20260807 06:17:48.142233 3958 tablet_copy_service.cc:161] P 83d7aa4650814f96815643b1b2bc5921: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ed249c1cbcf64e68a4277c034eba17ef at {username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:60838: session id = ed249c1cbcf64e68a4277c034eba17ef-00000000000000000000000000000000
I20260807 06:17:48.143316 3958 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:17:48.144560 4723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:17:48.147037 4723 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: tablet copy: Starting download of 0 data blocks...
I20260807 06:17:48.147259 4723 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: tablet copy: Starting download of 1 WAL segments...
I20260807 06:17:48.148844 4723 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:17:48.150436 3958 tablet_copy_service.cc:342] P 83d7aa4650814f96815643b1b2bc5921: Request end of tablet copy session ed249c1cbcf64e68a4277c034eba17ef-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:60838
I20260807 06:17:48.150514 3958 tablet_copy_service.cc:433] P 83d7aa4650814f96815643b1b2bc5921: ending tablet copy session ed249c1cbcf64e68a4277c034eba17ef-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ed249c1cbcf64e68a4277c034eba17ef
I20260807 06:17:48.157981 4723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:48.159752 4988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.159818 4992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.159998 4990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:48.160512 4723 server_base.cc:1034] running on GCE node
I20260807 06:17:48.160687 4723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:48.160985 4723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:48.162137 4723 hybrid_clock.cc:648] HybridClock initialized: now 1786083468162120 us; error 33 us; skew 500 ppm
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:48.163777 4723 init.cc:377] Logged in from keytab as oryx/127.26.252.124@KRBTEST.COM (short username oryx)
I20260807 06:17:48.164219 4723 webserver.cc:460] Webserver started at http://127.26.252.124:36021/ using document root <none> and password file <none>
I20260807 06:17:48.164407 4723 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:48.164451 4723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:48.165886 4723 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:48.166936 5000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.167228 4723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:48.167308 4723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "ed249c1cbcf64e68a4277c034eba17ef"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "b8fdc107679fc7e006e3bed1d9de4079"
server_key_iv: "efb2607f56e95110d3142c03760a1ecb"
server_key_version: "encryptionkey@0"
I20260807 06:17:48.167388 4723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:48.182615 4723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:48.184779 4723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:48.189819 4723 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.124:46601
I20260807 06:17:48.190441 4723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
I20260807 06:17:48.190846 5078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.124:46601 every 8 connection(s)
I20260807 06:17:48.192819 5079 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:17:48.194193 5079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Bootstrap starting.
I20260807 06:17:48.206389 5079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:17:48.206768 5079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Bootstrap complete.
I20260807 06:17:48.207393 5079 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } }
I20260807 06:17:48.207538 5079 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed249c1cbcf64e68a4277c034eba17ef, State: Initialized, Role: LEARNER
I20260807 06:17:48.207643 5079 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } }
I20260807 06:17:48.208027 5082 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.208133 5079 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:48.208264 5082 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: LEARNER
I20260807 06:17:48.212049 5094 catalog_manager.cc:1259] Loaded cluster ID: 268aa1fc47b845308a07d7234c97ddbf
I20260807 06:17:48.212193 5094 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: loading cluster ID for follower catalog manager: success
I20260807 06:17:48.214978 5094 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: acquiring CA information for follower catalog manager: success
I20260807 06:17:48.216552 5094 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:17:48.234310 4381 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
W20260807 06:17:48.234447 4972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:48.234786 4972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:48.234867 4972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:48.239311 4972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:48.239389 4972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:48.239497 4972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:48.244735 4972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:35519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=34143
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:48.245851 4972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:48.246994 4972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:48.257088 5103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.257089 5100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.257311 5101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:48.257413 4972 server_base.cc:1034] running on GCE node
I20260807 06:17:48.257975 4972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:48.258718 4972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:48.259929 4972 hybrid_clock.cc:648] HybridClock initialized: now 1786083468259889 us; error 49 us; skew 500 ppm
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:48.262984 4972 init.cc:377] Logged in from keytab as oryx/127.26.252.65@KRBTEST.COM (short username oryx)
I20260807 06:17:48.263859 4972 webserver.cc:460] Webserver started at http://127.26.252.65:34143/ using document root <none> and password file <none>
I20260807 06:17:48.264465 4972 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:48.264582 4972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:48.268869 4972 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:17:48.271438 5112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.272679 4972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:17:48.272823 4972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
format_stamp: "Formatted at 2026-08-07 06:17:46 on dist-test-slave-68xk"
server_key: "ddf5e1db3bfad10b5b69d93dd6439114"
server_key_iv: "0233c69d13f3ddeb57b709ab1a14b13a"
server_key_version: "encryptionkey@0"
I20260807 06:17:48.273387 4972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:48.285040 4972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:48.288285 4972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:48.288484 4972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:48.289083 4972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:48.289948 4972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:48.290020 4972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.290130 4972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:48.290184 4972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.299403 4972 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:35519
I20260807 06:17:48.299425 5264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:35519 every 8 connection(s)
I20260807 06:17:48.300405 4972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:48.301144 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 4972
I20260807 06:17:48.301347 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4199
I20260807 06:17:48.312839 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:43353
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:43159
--webserver_port=33681
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
I20260807 06:17:48.321110 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.307619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:52525 (local address 127.26.252.125:40451)
0807 06:17:48.307757 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.307762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.307778 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:17:48.307822 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.307825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.307873 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.307963 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.308540 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.309410 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.311777 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.312161 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312250 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.316310 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.316316 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.316322 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.316357 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.318302 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319086 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.319093 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.319098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.319197 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319660 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.319664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.319666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.319928 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.320026 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.320779 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.320920 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:17:48.321122 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.303820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:53769 (local address 127.26.252.126:43159)
0807 06:17:48.304555 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.304561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.304911 (+ 350us) server_negotiation.cc:407] Connection header received
0807 06:17:48.306302 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.306306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.306366 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.306476 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.308421 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.309412 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.311613 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.312020 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312109 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.315806 (+ 3697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.315813 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.315818 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.315852 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.318833 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319649 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.319653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.319655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.319749 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.320127 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.320131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.320133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.320354 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.320446 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.320806 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.320962 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594}
I20260807 06:17:48.322938 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.304458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:34715 (local address 127.26.252.124:46601)
0807 06:17:48.304820 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.304826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.306553 (+ 1727us) server_negotiation.cc:407] Connection header received
0807 06:17:48.306613 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.306618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.306681 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.306974 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.308430 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.309869 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.311579 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.311971 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312087 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.317873 (+ 5786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.317879 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.317885 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.317920 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.320130 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.320699 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.320705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.320708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.320817 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.321165 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.321171 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.321175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.321448 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.321552 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.322534 (+ 982us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.322685 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":74,"threads_started":1}
I20260807 06:17:48.322988 5273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.302623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:53769)
0807 06:17:48.304757 (+ 2134us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.304816 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.306037 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.306813 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.306821 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.307445 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.308242 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.308263 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.309606 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.309610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.311458 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.311473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.312284 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.312541 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.313592 (+ 1051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.313614 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.315602 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.319220 (+ 3618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319227 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.319229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.319511 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.319887 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.319892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.319992 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.320508 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.320512 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.320592 (+ 80us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.321352 (+ 760us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.321733 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1890,"mutex_wait_us":307,"thread_start_us":789,"threads_started":1}
I20260807 06:17:48.323413 5278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.306181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.26.252.65:52525)
0807 06:17:48.307332 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.307348 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.307445 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.308011 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.308016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.308234 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.308389 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.308400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.309603 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.309609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.311653 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.311660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.312445 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.312621 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.313447 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.313462 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.316158 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.318492 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.318499 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.318517 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.318928 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.319319 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.319322 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.319324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.319511 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.320104 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.320113 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.320446 (+ 333us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.321727 (+ 1281us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.321848 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1068,"mutex_wait_us":565,"spinlock_wait_cycles":1408,"thread_start_us":101,"threads_started":1}
I20260807 06:17:48.323581 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.304333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.26.252.65:34715)
0807 06:17:48.305984 (+ 1651us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.305999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.306118 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.306847 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.306853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.307445 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.308242 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.308303 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.310012 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.310015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.311448 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.311458 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.312271 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.312276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.312616 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.313359 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.313404 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.317673 (+ 4269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.320271 (+ 2598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.320277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.320282 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.320569 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.320937 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.320943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.320947 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.321047 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.321606 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.321611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.321725 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.321854 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.322022 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1578,"mutex_wait_us":178,"spinlock_wait_cycles":13184,"thread_start_us":92,"threads_started":1}
I20260807 06:17:48.324509 5266 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:48.324572 5265 heartbeater.cc:347] Connected to a master server at 127.26.252.124:46601
I20260807 06:17:48.324769 5265 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.324769 5266 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.324795 5268 heartbeater.cc:347] Connected to a master server at 127.26.252.125:40451
I20260807 06:17:48.324939 5268 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.325436 5268 heartbeater.cc:511] Master 127.26.252.125:40451 requested a full tablet report, sending...
I20260807 06:17:48.325438 5265 heartbeater.cc:511] Master 127.26.252.124:46601 requested a full tablet report, sending...
I20260807 06:17:48.325438 5266 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
I20260807 06:17:48.326922 3932 ts_manager.cc:194] Re-registered known tserver with Master: 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:48.327306 4771 ts_manager.cc:194] Registered new tserver with Master: 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:48.327644 3932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:53769
I20260807 06:17:48.328423 5024 ts_manager.cc:194] Registered new tserver with Master: 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
W20260807 06:17:48.432605 5280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:48.432833 5280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:48.432875 5280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:48.436823 5280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:48.436877 5280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:48.436969 5280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:48.442045 5280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:43353
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=33681
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:48.443105 5280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:48.444108 5280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:17:48.450454 4576 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
W20260807 06:17:48.454211 5285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.454241 5286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.454273 5288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:48.454582 5280 server_base.cc:1034] running on GCE node
I20260807 06:17:48.455039 5280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:48.455632 5280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:48.456805 5280 hybrid_clock.cc:648] HybridClock initialized: now 1786083468456793 us; error 24 us; skew 500 ppm
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:48.459554 5280 init.cc:377] Logged in from keytab as oryx/127.26.252.66@KRBTEST.COM (short username oryx)
I20260807 06:17:48.460409 5280 webserver.cc:460] Webserver started at http://127.26.252.66:33681/ using document root <none> and password file <none>
I20260807 06:17:48.460911 5280 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:48.460980 5280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:48.464804 5280 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:48.467082 5300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.468400 5280 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:48.468523 5280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "9156e738d876b31c7e38e3ea011c307e"
server_key_iv: "57674c56fb571ea84a986c6d0b0eb8dd"
server_key_version: "encryptionkey@0"
I20260807 06:17:48.469165 5280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:48.484870 5280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:48.488039 5280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:48.488189 5280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:48.488700 5280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:48.489485 5280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:48.489532 5280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.489573 5280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:48.489602 5280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.498458 5280 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:43353
I20260807 06:17:48.498517 5446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:43353 every 8 connection(s)
I20260807 06:17:48.499468 5280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:48.500824 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 5280
I20260807 06:17:48.501024 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4387
I20260807 06:17:48.512008 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:46265
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:43159
--webserver_port=45423
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:48.521009 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.503307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:34389 (local address 127.26.252.124:46601)
0807 06:17:48.503449 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.503453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.504634 (+ 1181us) server_negotiation.cc:407] Connection header received
0807 06:17:48.506037 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.506043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.506140 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.506239 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.508333 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509154 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511337 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511694 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511778 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.516020 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.516026 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.516032 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.516070 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.518241 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519076 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519170 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519615 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519839 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.519928 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.520704 (+ 776us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.520840 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:17:48.521009 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.503288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:48969 (local address 127.26.252.125:40451)
0807 06:17:48.503762 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.503769 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.506317 (+ 2548us) server_negotiation.cc:407] Connection header received
0807 06:17:48.506556 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.506562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.506636 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.506697 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.508336 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509250 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511345 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511696 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511782 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.515565 (+ 3783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.515568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.515571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.515594 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.517401 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519076 (+ 1675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519170 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519614 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519852 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.519928 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.520704 (+ 776us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.520840 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368}
I20260807 06:17:48.522127 5454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.501662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.26.252.66:34389)
0807 06:17:48.504442 (+ 2780us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.504501 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.505781 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.506561 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.506572 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.507282 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.508154 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.508174 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509358 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.509361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.511188 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.511201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511965 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.512280 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.513144 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.513170 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.515845 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.518488 (+ 2643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.518491 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.518493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.518952 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.519285 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519288 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.519290 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.519496 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.520002 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.520008 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.520403 (+ 395us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.521215 (+ 812us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.521372 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2548,"mutex_wait_us":763,"spinlock_wait_cycles":71808,"thread_start_us":1708,"threads_started":1}
I20260807 06:17:48.522362 5453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.503187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.26.252.66:48969)
0807 06:17:48.506225 (+ 3038us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.506242 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.506401 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.506877 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.506882 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.507282 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.508168 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.508182 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509457 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.509463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.511212 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.511224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511966 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.512323 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.513207 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.513228 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.515407 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.518370 (+ 2963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.518378 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.518393 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.518952 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.519285 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519288 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.519290 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.519496 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.520002 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.520008 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.520403 (+ 395us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.521159 (+ 756us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.521318 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2952,"mutex_wait_us":385,"spinlock_wait_cycles":59392,"thread_start_us":124,"threads_started":1}
I20260807 06:17:48.522672 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.504911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:53643 (local address 127.26.252.126:43159)
0807 06:17:48.505056 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.505064 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.506478 (+ 1414us) server_negotiation.cc:407] Connection header received
0807 06:17:48.506659 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.506663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.506721 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.506778 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.508332 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509154 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511339 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511681 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511761 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.516494 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.516498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.516502 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.516534 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.518241 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519117 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519230 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519639 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.519644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.519647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.519914 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.520021 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.522341 (+ 2320us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.522493 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:17:48.523379 5449 heartbeater.cc:347] Connected to a master server at 127.26.252.124:46601
I20260807 06:17:48.522131 5455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.504809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:53643)
0807 06:17:48.506359 (+ 1550us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.506373 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.506547 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.506930 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.506935 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.507281 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.508154 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.508174 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.509358 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.509361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.511207 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.511213 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.511965 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.511969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.512233 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.513144 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.513173 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.516360 (+ 3187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.518372 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.518381 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.518394 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.518979 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.519352 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.519357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.519360 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.519499 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.520075 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.520082 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.520412 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.520639 (+ 227us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.521015 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1476,"mutex_wait_us":640,"spinlock_wait_cycles":103680,"thread_start_us":93,"threads_started":1}
I20260807 06:17:48.523638 5449 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.524140 5450 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:48.524242 5450 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.524299 5449 heartbeater.cc:511] Master 127.26.252.124:46601 requested a full tablet report, sending...
I20260807 06:17:48.524472 5450 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
I20260807 06:17:48.524847 5451 heartbeater.cc:347] Connected to a master server at 127.26.252.125:40451
I20260807 06:17:48.524928 5451 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.525115 5451 heartbeater.cc:511] Master 127.26.252.125:40451 requested a full tablet report, sending...
I20260807 06:17:48.525537 5024 ts_manager.cc:194] Registered new tserver with Master: bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353)
I20260807 06:17:48.525928 4771 ts_manager.cc:194] Registered new tserver with Master: bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353)
I20260807 06:17:48.526360 3932 ts_manager.cc:194] Re-registered known tserver with Master: bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353)
I20260807 06:17:48.527388 3932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:53643
I20260807 06:17:48.548439 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.544693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52112 (local address 127.26.252.124:46601)
0807 06:17:48.544855 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.544859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.544879 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:17:48.544933 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.544935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.544999 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.545120 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.545353 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.546128 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.547220 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.547861 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.547990 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.548127 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.548217 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.548303 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:17:48.548441 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.544615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52112)
0807 06:17:48.544748 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.544765 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.544859 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.545134 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.545136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.545151 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.545235 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.545240 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.546242 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.546244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.547088 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.547098 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.547993 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.547996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.548090 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.548116 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.548201 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.548295 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 06:17:48.549186 5039 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 06:17:48.549559 5082 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83d7aa4650814f96815643b1b2bc5921. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.549722 5082 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: LEARNER
W20260807 06:17:48.633766 5456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:48.634050 5456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:48.634136 5456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:48.638837 5456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:48.638912 5456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:48.639003 5456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:48.644245 5456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:46265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=45423
--tserver_master_addrs=127.26.252.126:43159,127.26.252.125:40451,127.26.252.124:46601
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:48.645323 5456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:48.646347 5456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:48.656236 5468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.656241 5463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:48.656534 5465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:48.656622 5456 server_base.cc:1034] running on GCE node
I20260807 06:17:48.657055 5456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:48.657665 5456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:48.658825 5456 hybrid_clock.cc:648] HybridClock initialized: now 1786083468658808 us; error 28 us; skew 500 ppm
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:48.661491 5456 init.cc:377] Logged in from keytab as oryx/127.26.252.67@KRBTEST.COM (short username oryx)
I20260807 06:17:48.662308 5456 webserver.cc:460] Webserver started at http://127.26.252.67:45423/ using document root <none> and password file <none>
I20260807 06:17:48.662901 5456 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:48.663029 5456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:48.667171 5456 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:48.669314 5476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.670756 5456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:48.670877 5456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "ad494a1b227b4cb590b823660a5bdf24"
format_stamp: "Formatted at 2026-08-07 06:17:47 on dist-test-slave-68xk"
server_key: "6b93459f6d2adfe9a3aa61d67fa25c24"
server_key_iv: "8bc12d60997cf5d1fe9c463a70d0a8c4"
server_key_version: "encryptionkey@0"
I20260807 06:17:48.671411 5456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:48.691393 5456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:48.694376 5456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:48.694602 5456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:48.695143 5456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:48.696039 5456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:48.696101 5456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.696151 5456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:48.696171 5456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:48.706475 5456 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:46265
I20260807 06:17:48.706660 5617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:46265 every 8 connection(s)
I20260807 06:17:48.707657 5456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:48.711520 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 5456
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.124@KRBTEST.COM
Aug 07 06:17:48 dist-test-slave-68xk krb5kdc[3869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083468, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.125@KRBTEST.COM
I20260807 06:17:48.728663 5633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.714012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.26.252.126:43159)
0807 06:17:48.717014 (+ 3002us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.717021 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.717039 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:17:48.717080 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.717083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.717130 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.717225 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.718544 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.719351 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.720778 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.721219 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.721329 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.723457 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.723462 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.723468 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.723504 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.725863 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.726477 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.726482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.726484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.726628 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.727004 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.727009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.727012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.727359 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.727524 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.728229 (+ 705us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.728402 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":2920,"thread_start_us":94,"threads_started":1}
I20260807 06:17:48.730932 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.710176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:53523 (local address 127.26.252.125:40451)
0807 06:17:48.710342 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.710348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.711700 (+ 1352us) server_negotiation.cc:407] Connection header received
0807 06:17:48.713323 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.713330 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.713389 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.713448 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.715509 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716349 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718223 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.718593 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718687 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.725959 (+ 7272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.725964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.725968 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.725997 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.728025 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.728854 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.728858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.728859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.728974 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729436 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.729439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.729441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.729720 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.729830 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.730597 (+ 767us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.730759 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 06:17:48.731775 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.709877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:33165 (local address 127.26.252.124:46601)
0807 06:17:48.710054 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.710060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.711947 (+ 1887us) server_negotiation.cc:407] Connection header received
0807 06:17:48.713067 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.713071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.713136 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.713222 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.715527 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716430 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.719675 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.720011 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.720089 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.724416 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.724419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.724422 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.724449 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.728495 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.730154 (+ 1659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.730158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.730160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.730265 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.730665 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.730669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.730671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.730905 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.731003 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.731475 (+ 472us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.731618 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":75}
I20260807 06:17:48.732800 5634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.714058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33830 (local address 127.26.252.125:40451)
0807 06:17:48.714672 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.714676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.715619 (+ 943us) server_negotiation.cc:407] Connection header received
0807 06:17:48.715654 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.715657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.715700 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.715790 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.716785 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.717557 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.720679 (+ 3122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.721067 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.721178 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.725445 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.725450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.725454 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.725485 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.729272 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.730138 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.730142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.730143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.730227 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.731242 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.731246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.731248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.731461 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.731585 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.732496 (+ 911us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.732623 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":82,"threads_started":1}
I20260807 06:17:48.732916 5624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.710403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.26.252.67:33165)
0807 06:17:48.711855 (+ 1452us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.711865 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.712863 (+ 998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.714950 (+ 2087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.714954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.715171 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.715341 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.715356 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716600 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.716604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.719509 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.719521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.720431 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.720435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.720524 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.721357 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.721371 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.724193 (+ 2822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.729377 (+ 5184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729379 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.729381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.730013 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.730389 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.730392 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.730394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.730531 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.731151 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.731154 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.731255 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.731918 (+ 663us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.732070 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1340,"mutex_wait_us":1846,"spinlock_wait_cycles":29952,"thread_start_us":127,"threads_started":1}
I20260807 06:17:48.733247 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.710402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.26.252.67:53523)
0807 06:17:48.711536 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.711593 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.713184 (+ 1591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.713654 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.713658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.714317 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.715332 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.715354 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716534 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.716537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.718077 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.718089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.718854 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.719077 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.720300 (+ 1223us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.720316 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.725758 (+ 5442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.728164 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.728167 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.728169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.728713 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.729097 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729101 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.729103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.729309 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.729832 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.729843 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.730231 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.731203 (+ 972us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.731621 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"mutex_wait_us":164,"spinlock_wait_cycles":4352,"thread_start_us":140,"threads_started":1}
I20260807 06:17:48.734241 5618 heartbeater.cc:347] Connected to a master server at 127.26.252.124:46601
I20260807 06:17:48.734531 5618 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.734990 5621 heartbeater.cc:347] Connected to a master server at 127.26.252.125:40451
I20260807 06:17:48.735076 5621 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.735225 5618 heartbeater.cc:511] Master 127.26.252.124:46601 requested a full tablet report, sending...
I20260807 06:17:48.732649 3932 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:17:48.735234 5621 heartbeater.cc:511] Master 127.26.252.125:40451 requested a full tablet report, sending...
I20260807 06:17:48.736668 5024 ts_manager.cc:194] Registered new tserver with Master: ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67:46265)
W20260807 06:17:48.736991 3932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:48.737118 4771 ts_manager.cc:194] Registered new tserver with Master: ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67:46265)
I20260807 06:17:48.738082 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.711504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:55495)
0807 06:17:48.712008 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.712025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.712892 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.713612 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.713620 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.714360 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:48.715348 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.715356 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716600 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.716604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.718079 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.718091 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.718971 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.719144 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.720241 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:48.720267 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:48.725020 (+ 4753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:48.727971 (+ 2951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.727978 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.727998 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.728974 (+ 976us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.729349 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:48.729358 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:48.729460 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:48.730594 (+ 1134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:48.730598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:48.730743 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.737729 (+ 6986us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.737894 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":294,"spinlock_wait_cycles":24704,"thread_start_us":92,"threads_started":1}
I20260807 06:17:48.738121 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.711607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:55495 (local address 127.26.252.126:43159)
0807 06:17:48.711741 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.711746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.712137 (+ 391us) server_negotiation.cc:407] Connection header received
0807 06:17:48.713122 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.713127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.713191 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.713253 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.715527 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.716435 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718235 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.718676 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.718777 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.725230 (+ 6453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.725238 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.725243 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.725277 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.727631 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729107 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.729114 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.729119 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.729211 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.729572 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.729576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.729579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.729811 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.729887 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.737824 (+ 7937us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.737952 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":56}
I20260807 06:17:48.738127 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.714393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.26.252.124:46601)
0807 06:17:48.718202 (+ 3809us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.718209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.718225 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:17:48.718262 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.718265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.718312 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.718395 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.719999 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.723238 (+ 3239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.724382 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.724779 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.724883 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.727799 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.727806 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.727808 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.727854 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.735363 (+ 7509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.736151 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.736154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.736155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.736279 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.736681 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.736684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.736686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.736953 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.737108 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.737785 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.737934 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1565,"server-negotiator.queue_time_us":3710,"thread_start_us":64,"threads_started":1}
I20260807 06:17:48.739260 5620 heartbeater.cc:347] Connected to a master server at 127.26.252.126:43159
I20260807 06:17:48.739358 5620 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:48.739569 5620 heartbeater.cc:511] Master 127.26.252.126:43159 requested a full tablet report, sending...
I20260807 06:17:48.740273 3930 ts_manager.cc:194] Re-registered known tserver with Master: ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67:46265)
I20260807 06:17:48.740558 4977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: NON_VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: true } } }
I20260807 06:17:48.740697 4977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.741050 3930 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:55495
I20260807 06:17:48.743888 4977 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: attempting to promote NON_VOTER ed249c1cbcf64e68a4277c034eba17ef to VOTER
I20260807 06:17:48.744261 4977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:48.745587 4782 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 06:17:48.745628 5039 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 LEARNER]: Refusing update from remote peer 83d7aa4650814f96815643b1b2bc5921: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 06:17:48.745999 5640 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 06:17:48.746352 5640 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 06:17:48.747921 4977 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.748843 5039 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.749590 5640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.749712 5640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.749647 4782 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.751185 4977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.751358 4977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.751420 5640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.751547 5640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:48.751601 5082 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.751757 5082 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:48.752141 5653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "83d7aa4650814f96815643b1b2bc5921" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:48.752279 5653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:48.760892 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.754350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46265 (local address 127.0.0.1:53598)
0807 06:17:48.754529 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.754547 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.754624 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.756205 (+ 1581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.756209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.756231 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.756358 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.756370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.757955 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.757959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.759220 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.759232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.760307 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.760314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.760509 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.760547 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.760632 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.760738 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":65}
I20260807 06:17:48.760921 5655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.754832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53598 (local address 127.26.252.67:46265)
0807 06:17:48.755659 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.755672 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.755697 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:17:48.755777 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.755783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.756008 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.756238 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.756515 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.757798 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.759343 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.760166 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.760391 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.760561 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.760661 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.760768 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":113,"threads_started":1}
I20260807 06:17:48.761989 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.755668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35519 (local address 127.0.0.1:45862)
0807 06:17:48.757091 (+ 1423us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.757105 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.757189 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.757910 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.757914 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.757941 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.758035 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.758041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.759184 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.759190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.760425 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.760435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.761519 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.761523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.761627 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.761654 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.761752 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.761831 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1364,"mutex_wait_us":48,"thread_start_us":119,"threads_started":1}
I20260807 06:17:48.762321 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.755172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39716 (local address 127.26.252.66:43353)
0807 06:17:48.756551 (+ 1379us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.756562 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.756584 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:17:48.756660 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.756666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.756854 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.757018 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.757347 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.758504 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.760560 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.761659 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.761782 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.761921 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.762037 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.762156 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1279,"thread_start_us":111,"threads_started":1}
I20260807 06:17:48.762780 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.755848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.26.252.65:35519)
0807 06:17:48.757472 (+ 1624us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.757483 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.757505 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:17:48.757575 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.757580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.757741 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.757895 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.758160 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.759065 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.760563 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.761375 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.761482 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.761604 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.762555 (+ 951us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.762655 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1521,"thread_start_us":114,"threads_started":1}
I20260807 06:17:48.762177 5654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.754610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:43353 (local address 127.0.0.1:39716)
0807 06:17:48.754881 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.754894 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.754973 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.756995 (+ 2022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.756998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.757019 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.757124 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.757211 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.758624 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.758628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.760408 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.760420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.761795 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.761799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.761891 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.761915 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.761988 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.762054 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":43,"thread_start_us":142,"threads_started":1}
I20260807 06:17:48.764201 5532 tablet_service.cc:1467] Processing CreateTablet for tablet c77d0cb4f40742588967f9277eec2380 (DEFAULT_TABLE table=test-table [id=8c83bb4f75214d52904590a45569a14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:48.765365 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c77d0cb4f40742588967f9277eec2380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:48.765730 5365 tablet_service.cc:1467] Processing CreateTablet for tablet c77d0cb4f40742588967f9277eec2380 (DEFAULT_TABLE table=test-table [id=8c83bb4f75214d52904590a45569a14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:48.766758 5365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c77d0cb4f40742588967f9277eec2380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:48.768381 5178 tablet_service.cc:1467] Processing CreateTablet for tablet c77d0cb4f40742588967f9277eec2380 (DEFAULT_TABLE table=test-table [id=8c83bb4f75214d52904590a45569a14c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:48.769388 5178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c77d0cb4f40742588967f9277eec2380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:48.775144 5662 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Bootstrap starting.
I20260807 06:17:48.776715 5663 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Bootstrap starting.
I20260807 06:17:48.777242 5662 tablet_bootstrap.cc:654] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:48.778142 5662 log.cc:824] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:48.778874 5661 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Bootstrap starting.
I20260807 06:17:48.778978 5663 tablet_bootstrap.cc:654] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:48.779902 5663 log.cc:824] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:48.781286 5661 tablet_bootstrap.cc:654] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:48.782207 5661 log.cc:824] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:48.782313 5663 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: No bootstrap required, opened a new log
I20260807 06:17:48.782593 5663 ts_tablet_manager.cc:1397] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:17:48.784235 5661 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: No bootstrap required, opened a new log
I20260807 06:17:48.784235 5662 tablet_bootstrap.cc:492] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: No bootstrap required, opened a new log
I20260807 06:17:48.784426 5662 ts_tablet_manager.cc:1397] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 06:17:48.784426 5661 ts_tablet_manager.cc:1397] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:17:48.786919 5663 raft_consensus.cc:348] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.787189 5663 raft_consensus.cc:374] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:48.787248 5663 raft_consensus.cc:729] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2a5dbdafeb44a79b4c25ad2fab615b, State: Initialized, Role: FOLLOWER
I20260807 06:17:48.787746 5663 consensus_queue.cc:260] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.788852 5663 ts_tablet_manager.cc:1428] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:17:48.789149 5266 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
I20260807 06:17:48.789088 5661 raft_consensus.cc:348] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.789088 5662 raft_consensus.cc:348] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.789324 5661 raft_consensus.cc:374] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:48.789324 5662 raft_consensus.cc:374] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:48.789383 5662 raft_consensus.cc:729] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc35ffe8bba94add9f6f1748ee9c1aa1, State: Initialized, Role: FOLLOWER
I20260807 06:17:48.789384 5661 raft_consensus.cc:729] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad494a1b227b4cb590b823660a5bdf24, State: Initialized, Role: FOLLOWER
I20260807 06:17:48.789803 5662 consensus_queue.cc:260] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.789826 5661 consensus_queue.cc:260] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.790776 5661 ts_tablet_manager.cc:1428] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:17:48.790774 5662 ts_tablet_manager.cc:1428] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260807 06:17:48.792001 5620 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
I20260807 06:17:48.792480 5450 heartbeater.cc:503] Master 127.26.252.126:43159 was elected leader, sending a full tablet report...
I20260807 06:17:48.796134 5674 raft_consensus.cc:482] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:48.796334 5674 raft_consensus.cc:504] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.797442 5674 leader_election.cc:288] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353), 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:48.803289 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.798532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:43863 (local address 127.26.252.66:43353)
0807 06:17:48.798665 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.798671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.798686 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:48.798733 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.798737 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.798786 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.798872 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.799316 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.800177 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.801732 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.802372 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.802554 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.802611 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.803075 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.803167 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:48.803319 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.797737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:43353 (local address 127.26.252.67:43863)
0807 06:17:48.798073 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.798092 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.798186 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.798998 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.799001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.799020 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.799166 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.799175 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.800323 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.800326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.801600 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.801610 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.802778 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.802782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.802906 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.802949 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.803059 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.803160 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256}
I20260807 06:17:48.803602 5624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.798044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35519 (local address 127.26.252.67:47017)
0807 06:17:48.798217 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:48.798233 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:48.798327 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:48.800191 (+ 1864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:48.800193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:48.800211 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:48.800304 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.800309 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.801375 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.801378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.802323 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:48.802336 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.803201 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.803205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:48.803317 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.803343 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:17:48.803400 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 06:17:48.803491 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 06:17:48.804006 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.798614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:47017 (local address 127.26.252.65:35519)
0807 06:17:48.799963 (+ 1349us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.799968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.799983 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:48.800026 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.800029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.800071 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.800151 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:48.800426 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.801245 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.802483 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.803053 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.803797 (+ 744us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.803843 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.803877 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.803925 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1265}
I20260807 06:17:48.804014 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77d0cb4f40742588967f9277eec2380" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" is_pre_election: true
I20260807 06:17:48.804355 5389 raft_consensus.cc:2454] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 0.
I20260807 06:17:48.804538 5204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77d0cb4f40742588967f9277eec2380" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" is_pre_election: true
I20260807 06:17:48.804834 5204 raft_consensus.cc:2454] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 0.
I20260807 06:17:48.804862 5479 leader_election.cc:302] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad494a1b227b4cb590b823660a5bdf24, bc35ffe8bba94add9f6f1748ee9c1aa1; no voters:
I20260807 06:17:48.805326 5676 raft_consensus.cc:2781] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:48.805469 5676 raft_consensus.cc:482] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:48.805537 5676 raft_consensus.cc:3037] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:48.807178 5676 raft_consensus.cc:504] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
W20260807 06:17:48.807279 5269 tablet.cc:2369] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:48.807525 5676 leader_election.cc:288] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 election: Requested vote from peers bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353), 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:48.808327 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77d0cb4f40742588967f9277eec2380" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
I20260807 06:17:48.808476 5389 raft_consensus.cc:3037] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:48.808710 5204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77d0cb4f40742588967f9277eec2380" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
I20260807 06:17:48.808852 5204 raft_consensus.cc:3037] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:48.810560 5204 raft_consensus.cc:2454] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 1.
I20260807 06:17:48.810920 5479 leader_election.cc:302] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2a5dbdafeb44a79b4c25ad2fab615b, ad494a1b227b4cb590b823660a5bdf24; no voters:
I20260807 06:17:48.811125 5676 raft_consensus.cc:2781] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:48.811254 5676 raft_consensus.cc:686] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 1 LEADER]: Becoming Leader. State: Replica: ad494a1b227b4cb590b823660a5bdf24, State: Running, Role: LEADER
I20260807 06:17:48.811735 5676 consensus_queue.cc:237] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:48.816017 3932 catalog_manager.cc:5495] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "ad494a1b227b4cb590b823660a5bdf24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:48.816726 5389 raft_consensus.cc:2454] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 1.
I20260807 06:17:48.846339 5655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.840940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53610 (local address 127.26.252.67:46265)
0807 06:17:48.841097 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.841102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.841117 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:48.841280 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.841282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.841339 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.841453 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:48.841766 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.842568 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.844010 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.844585 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.844714 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.845219 (+ 505us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:48.845816 (+ 597us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:48.845956 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.846025 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.846139 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:17:48.854780 5204 raft_consensus.cc:1261] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Refusing update from remote peer ad494a1b227b4cb590b823660a5bdf24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:48.854784 5389 raft_consensus.cc:1261] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Refusing update from remote peer ad494a1b227b4cb590b823660a5bdf24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:48.855599 5676 consensus_queue.cc:1035] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:48.856127 5676 consensus_queue.cc:1035] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:48.864746 5684 mvcc.cc:205] Tried to move back new op lower bound from 7315797888420438016 to 7315797888257953792. Current Snapshot: MvccSnapshot[applied={T|T < 7315797888420438016}]
I20260807 06:17:48.865980 5682 mvcc.cc:205] Tried to move back new op lower bound from 7315797888420438016 to 7315797888257953792. Current Snapshot: MvccSnapshot[applied={T|T < 7315797888420438016}]
I20260807 06:17:48.887265 3932 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:48.887430 3932 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:48.892784 3932 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83d7aa4650814f96815643b1b2bc5921: Sending DeleteTablet for 3 replicas of tablet c77d0cb4f40742588967f9277eec2380
I20260807 06:17:48.893579 5532 tablet_service.cc:1514] Processing DeleteTablet for tablet c77d0cb4f40742588967f9277eec2380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:48 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:53598
I20260807 06:17:48.893841 5365 tablet_service.cc:1514] Processing DeleteTablet for tablet c77d0cb4f40742588967f9277eec2380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:48 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:39716
I20260807 06:17:48.894006 5178 tablet_service.cc:1514] Processing DeleteTablet for tablet c77d0cb4f40742588967f9277eec2380 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:48 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:45862
I20260807 06:17:48.894528 5696 tablet_replica.cc:330] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: stopping tablet replica
I20260807 06:17:48.894860 5696 raft_consensus.cc:2229] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:48.895227 5696 raft_consensus.cc:2258] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:48.895781 5697 tablet_replica.cc:330] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: stopping tablet replica
I20260807 06:17:48.895922 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 3887
I20260807 06:17:48.903330 5697 raft_consensus.cc:2229] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:48.903645 5697 raft_consensus.cc:2258] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:48.906196 5696 ts_tablet_manager.cc:1905] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:48.906189 5697 ts_tablet_manager.cc:1905] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:48.909301 5696 ts_tablet_manager.cc:1918] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:48.909312 5697 ts_tablet_manager.cc:1918] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:48.909426 5696 log.cc:1196] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/c77d0cb4f40742588967f9277eec2380
I20260807 06:17:48.909426 5697 log.cc:1196] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/c77d0cb4f40742588967f9277eec2380
I20260807 06:17:48.909799 5696 ts_tablet_manager.cc:1939] T c77d0cb4f40742588967f9277eec2380 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting consensus metadata
I20260807 06:17:48.909893 5697 ts_tablet_manager.cc:1939] T c77d0cb4f40742588967f9277eec2380 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Deleting consensus metadata
I20260807 06:17:48.911875 5694 tablet_replica.cc:330] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: stopping tablet replica
I20260807 06:17:48.912322 5694 raft_consensus.cc:2229] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:48.912833 5694 raft_consensus.cc:2258] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:48.914573 5694 ts_tablet_manager.cc:1905] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:17:48.915254 5115 connection.cc:535] server connection from 127.0.0.1:45862 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 06:17:48.915738 5304 connection.cc:535] server connection from 127.0.0.1:39716 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:17:48.917738 5694 ts_tablet_manager.cc:1918] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:48.917851 5694 log.cc:1196] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/c77d0cb4f40742588967f9277eec2380
I20260807 06:17:48.918293 5694 ts_tablet_manager.cc:1939] T c77d0cb4f40742588967f9277eec2380 P ad494a1b227b4cb590b823660a5bdf24: Deleting consensus metadata
W20260807 06:17:48.919509 5479 connection.cc:441] server connection from 127.0.0.1:53598 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53598 (request call id 1) could send its response
I20260807 06:17:48.921450 5634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.895378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.26.252.125:40451)
0807 06:17:48.895521 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.895526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.911528 (+ 16002us) server_negotiation.cc:407] Connection header received
0807 06:17:48.911691 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.911694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.911763 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.911840 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.913014 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.913816 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.915023 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.915359 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.915445 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.917429 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.917433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.917436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.917468 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.919335 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.919864 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.919867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.919869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.919967 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.920338 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.920342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.920343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.920593 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.920710 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.921104 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.921256 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:17:48.931959 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.920584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.26.252.125:40451)
0807 06:17:48.920709 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.920714 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.921342 (+ 628us) server_negotiation.cc:407] Connection header received
0807 06:17:48.921888 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.921892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.921950 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.922004 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.923342 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.924136 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.925296 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.925666 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.925747 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.927968 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.927973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.927976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.928003 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.929846 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.930401 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.930406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.930408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.930531 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.930881 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.930885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.930887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.931124 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.931239 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.931643 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.931783 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:17:48.933153 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.895453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52138 (local address 127.26.252.124:46601)
0807 06:17:48.895598 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.895604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.922959 (+ 27355us) server_negotiation.cc:407] Connection header received
0807 06:17:48.923067 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.923073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.923123 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.923212 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.924090 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.924887 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.926015 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.926739 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.926823 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.928564 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.928571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.928576 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.928607 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.930983 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.931615 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.931619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.931621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.931729 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.932171 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.932174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.932187 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.932408 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.932503 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.932856 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.932986 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40,"spinlock_wait_cycles":896}
I20260807 06:17:48.933525 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:48.920911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52150 (local address 127.26.252.124:46601)
0807 06:17:48.921055 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:48.921061 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:48.921588 (+ 527us) server_negotiation.cc:407] Connection header received
0807 06:17:48.921796 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:48.921800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:48.921855 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:48.921913 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:48.923481 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.924371 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.925851 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:48.926243 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:48.926324 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:48.928650 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:48.928656 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:48.928660 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:48.928692 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:48.931010 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.931615 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.931619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.931621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.931833 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:48.932390 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:48.932393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:48.932395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:48.932584 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:48.932671 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:48.933255 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 06:17:48.933368 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":63,"spinlock_wait_cycles":4992}
I20260807 06:17:49.870724 5709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:49.870159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:53821)
0807 06:17:49.870497 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:49.870610 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":96,"threads_started":1}
W20260807 06:17:49.871115 5450 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:43159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:49.873327 5710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:49.872759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:59079)
0807 06:17:49.873032 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:49.873129 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":109,"threads_started":1}
W20260807 06:17:49.873768 5620 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:43159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:49.875293 5711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:49.874757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:34519)
0807 06:17:49.875053 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:49.875134 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":74,"threads_started":1}
W20260807 06:17:49.875737 5266 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:43159 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.393050 5712 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d7aa4650814f96815643b1b2bc5921)
I20260807 06:17:50.393339 5712 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:50.393530 5714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 83d7aa4650814f96815643b1b2bc5921)
I20260807 06:17:50.393734 5714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:50.394496 5712 leader_election.cc:288] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), 69c8376eea494bf19620ba745263cd45 (127.26.252.125:40451)
I20260807 06:17:50.394665 5714 leader_election.cc:288] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124:46601)
I20260807 06:17:50.395473 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.394805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33080)
0807 06:17:50.395281 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.395347 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":68,"threads_started":1}
W20260807 06:17:50.395678 4750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.396220 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.395670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33066)
0807 06:17:50.396054 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.396131 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":73,"threads_started":1}
W20260807 06:17:50.396391 5001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.397300 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.397050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33088)
0807 06:17:50.397160 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.397217 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:17:50.397503 5001 leader_election.cc:334] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.398043 5716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.397780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33100)
0807 06:17:50.397905 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.397961 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 06:17:50.398229 4750 leader_election.cc:334] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.399657 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.395499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33856 (local address 127.26.252.125:40451)
0807 06:17:50.395750 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:50.395757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:50.395827 (+ 70us) server_negotiation.cc:407] Connection header received
0807 06:17:50.395879 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:50.395882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:50.395930 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:50.396398 (+ 468us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:50.396503 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.397279 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.398757 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.399187 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.399342 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:50.399424 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:50.399459 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 06:17:50.399529 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
I20260807 06:17:50.399665 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.395069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:46601 (local address 127.0.0.1:52154)
0807 06:17:50.395621 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.395635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:50.395738 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:50.396174 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:50.396176 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:50.396191 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:50.396296 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:50.396302 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.397300 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.397306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:50.398477 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:50.398488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.399194 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.399197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:50.399338 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:50.399402 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 06:17:50.399476 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:17:50.399530 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":42,"thread_start_us":73,"threads_started":1}
I20260807 06:17:50.399677 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.394709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:40451 (local address 127.0.0.1:33856)
0807 06:17:50.394969 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.394981 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:50.395100 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:50.396082 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:50.396086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:50.396163 (+ 77us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:50.396277 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:50.396286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.397391 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.397396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:50.398642 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:50.398651 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.399306 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.399309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:50.399366 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:50.399382 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 06:17:50.399430 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 06:17:50.399518 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"spinlock_wait_cycles":1792,"thread_start_us":69,"threads_started":1}
I20260807 06:17:50.399677 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.395260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52154 (local address 127.26.252.124:46601)
0807 06:17:50.395491 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:50.395498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:50.395830 (+ 332us) server_negotiation.cc:407] Connection header received
0807 06:17:50.395881 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:50.395884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:50.395940 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:50.396033 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:50.396422 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.397185 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.398614 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:50.399078 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:50.399170 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:50.399208 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:50.399504 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 06:17:50.399562 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
I20260807 06:17:50.400125 4782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed249c1cbcf64e68a4277c034eba17ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "69c8376eea494bf19620ba745263cd45" is_pre_election: true
I20260807 06:17:50.400128 5039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "69c8376eea494bf19620ba745263cd45" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ed249c1cbcf64e68a4277c034eba17ef" is_pre_election: true
I20260807 06:17:50.400331 4782 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed249c1cbcf64e68a4277c034eba17ef in term 1.
I20260807 06:17:50.400327 5039 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69c8376eea494bf19620ba745263cd45 in term 1.
I20260807 06:17:50.400703 4750 leader_election.cc:302] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c8376eea494bf19620ba745263cd45, ed249c1cbcf64e68a4277c034eba17ef; no voters: 83d7aa4650814f96815643b1b2bc5921
I20260807 06:17:50.400708 5003 leader_election.cc:302] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c8376eea494bf19620ba745263cd45, ed249c1cbcf64e68a4277c034eba17ef; no voters: 83d7aa4650814f96815643b1b2bc5921
I20260807 06:17:50.400918 5714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 06:17:50.400979 5714 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d7aa4650814f96815643b1b2bc5921)
I20260807 06:17:50.401021 5714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:17:50.402083 5714 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:50.402472 5714 leader_election.cc:288] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 election: Requested vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), ed249c1cbcf64e68a4277c034eba17ef (127.26.252.124:46601)
I20260807 06:17:50.402511 5712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 06:17:50.402562 5712 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Starting leader election (detected failure of leader 83d7aa4650814f96815643b1b2bc5921)
I20260807 06:17:50.402616 5712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:17:50.402913 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.402606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33102)
0807 06:17:50.402828 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.402867 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260807 06:17:50.403040 5039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "69c8376eea494bf19620ba745263cd45" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ed249c1cbcf64e68a4277c034eba17ef"
I20260807 06:17:50.403625 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.403383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33108)
0807 06:17:50.403494 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.403552 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 06:17:50.403769 4750 leader_election.cc:334] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.403996 5712 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:50.404240 5039 raft_consensus.cc:2379] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 69c8376eea494bf19620ba745263cd45 in current term 2: Already voted for candidate ed249c1cbcf64e68a4277c034eba17ef in this term.
I20260807 06:17:50.404388 5712 leader_election.cc:288] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 election: Requested vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), 69c8376eea494bf19620ba745263cd45 (127.26.252.125:40451)
I20260807 06:17:50.404667 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.404481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33110)
0807 06:17:50.404562 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.404608 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 06:17:50.404795 4782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed249c1cbcf64e68a4277c034eba17ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "69c8376eea494bf19620ba745263cd45"
I20260807 06:17:50.404951 4782 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed249c1cbcf64e68a4277c034eba17ef in current term 2: Already voted for candidate 69c8376eea494bf19620ba745263cd45 in this term.
I20260807 06:17:50.405311 5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.405103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:33114)
0807 06:17:50.405193 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.405246 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 06:17:50.405448 4750 leader_election.cc:302] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69c8376eea494bf19620ba745263cd45; no voters: 83d7aa4650814f96815643b1b2bc5921, ed249c1cbcf64e68a4277c034eba17ef
W20260807 06:17:50.405462 5001 leader_election.cc:334] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:50.405550 5001 leader_election.cc:302] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed249c1cbcf64e68a4277c034eba17ef; no voters: 69c8376eea494bf19620ba745263cd45, 83d7aa4650814f96815643b1b2bc5921
I20260807 06:17:50.405609 5714 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 06:17:50.405766 5712 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 06:17:50.872156 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.871661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:40703)
0807 06:17:50.871970 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.872061 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260807 06:17:50.874868 5726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.874369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:36355)
0807 06:17:50.874712 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.874786 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":144,"threads_started":1}
I20260807 06:17:50.876889 5727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:50.876359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:43469)
0807 06:17:50.876688 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:50.876782 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
I20260807 06:17:51.873581 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.872913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:39837)
0807 06:17:51.873350 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.873463 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":118,"threads_started":1}
I20260807 06:17:51.876040 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.875572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:49623)
0807 06:17:51.875852 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.875935 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":78,"threads_started":1}
I20260807 06:17:51.878321 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.877835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:52401)
0807 06:17:51.878095 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.878170 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":83,"threads_started":1}
I20260807 06:17:51.991204 5733 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:51.991374 5733 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:51.991910 5733 leader_election.cc:288] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), 69c8376eea494bf19620ba745263cd45 (127.26.252.125:40451)
I20260807 06:17:51.992460 4782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed249c1cbcf64e68a4277c034eba17ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "69c8376eea494bf19620ba745263cd45" is_pre_election: true
I20260807 06:17:51.992637 4782 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed249c1cbcf64e68a4277c034eba17ef in term 2.
I20260807 06:17:51.992640 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.992195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46508)
0807 06:17:51.992462 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.992525 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":99,"threads_started":1}
I20260807 06:17:51.993037 5003 leader_election.cc:302] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69c8376eea494bf19620ba745263cd45, ed249c1cbcf64e68a4277c034eba17ef; no voters:
I20260807 06:17:51.993287 5733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 06:17:51.993358 5733 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:51.993398 5733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:17:51.993723 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.993406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46524)
0807 06:17:51.993592 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.993651 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 06:17:51.993952 5001 leader_election.cc:334] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:51.994899 5733 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:51.995266 5733 leader_election.cc:288] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 election: Requested vote from peers 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159), 69c8376eea494bf19620ba745263cd45 (127.26.252.125:40451)
I20260807 06:17:51.995618 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.995382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46546)
0807 06:17:51.995480 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.995553 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 06:17:51.995633 4782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed249c1cbcf64e68a4277c034eba17ef" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "69c8376eea494bf19620ba745263cd45"
I20260807 06:17:51.995751 4782 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:17:51.996346 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:51.996118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46552)
0807 06:17:51.996237 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:51.996288 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 06:17:51.996479 5001 leader_election.cc:334] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
I20260807 06:17:51.997002 4782 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed249c1cbcf64e68a4277c034eba17ef in term 3.
I20260807 06:17:51.997347 5003 leader_election.cc:302] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69c8376eea494bf19620ba745263cd45, ed249c1cbcf64e68a4277c034eba17ef; no voters: 83d7aa4650814f96815643b1b2bc5921
I20260807 06:17:51.997514 5733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:17:51.997745 5733 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [term 3 LEADER]: Becoming Leader. State: Replica: ed249c1cbcf64e68a4277c034eba17ef, State: Running, Role: LEADER
I20260807 06:17:51.998019 5733 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } }
I20260807 06:17:51.999533 5741 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed249c1cbcf64e68a4277c034eba17ef. Latest consensus state: current_term: 3 leader_uuid: "ed249c1cbcf64e68a4277c034eba17ef" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:51.999666 5741 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:51.999955 5745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:52.002334 5745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:52.002787 5745 catalog_manager.cc:1259] Loaded cluster ID: 268aa1fc47b845308a07d7234c97ddbf
I20260807 06:17:52.002861 5745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:52.003428 5745 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:52.003827 5745 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Loaded TSK: 0
I20260807 06:17:52.004660 5745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:17:52.080076 5023 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52150:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:52.083230 5023 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:52.086306 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.085955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46562)
0807 06:17:52.086154 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.086222 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 06:17:52.086333 4782 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [term 3 FOLLOWER]: Refusing update from remote peer ed249c1cbcf64e68a4277c034eba17ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 06:17:52.086874 5741 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 06:17:52.087129 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.086864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.0.0.1:46566)
0807 06:17:52.086985 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.087062 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 06:17:52.087337 5001 consensus_peers.cc:487] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef -> Peer 83d7aa4650814f96815643b1b2bc5921 (127.26.252.126:43159): Couldn't send request to peer 83d7aa4650814f96815643b1b2bc5921. Status: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 06:17:52.088364 5747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed249c1cbcf64e68a4277c034eba17ef. Latest consensus state: current_term: 3 leader_uuid: "ed249c1cbcf64e68a4277c034eba17ef" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:52.088524 5747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:52.089854 5741 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ed249c1cbcf64e68a4277c034eba17ef" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:52.089970 5741 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:52.089860 5747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ed249c1cbcf64e68a4277c034eba17ef" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "83d7aa4650814f96815643b1b2bc5921" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43159 } } peers { permanent_uuid: "69c8376eea494bf19620ba745263cd45" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 40451 } attrs { promote: false } } peers { permanent_uuid: "ed249c1cbcf64e68a4277c034eba17ef" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 46601 } attrs { promote: false } } }
I20260807 06:17:52.090082 5747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69c8376eea494bf19620ba745263cd45 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:17:52.100883 5735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.095850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:43353 (local address 127.0.0.1:53090)
0807 06:17:52.095987 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.096002 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:52.096093 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:52.096980 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:52.096983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:52.097004 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:52.097110 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.097116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098247 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.098251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.099543 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.099553 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100436 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.100531 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.100559 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:17:52.100648 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 06:17:52.100742 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":23}
I20260807 06:17:52.100914 5756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.096340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.26.252.66:43353)
0807 06:17:52.096712 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:52.096717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:52.096732 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:52.096791 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:52.096797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:52.096851 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:52.096940 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:52.097276 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098099 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.099692 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100311 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100411 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.100475 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:52.100675 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 06:17:52.100766 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":75,"threads_started":1}
I20260807 06:17:52.101203 5755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.096114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46265 (local address 127.0.0.1:34484)
0807 06:17:52.096371 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.096386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:52.096478 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:52.097558 (+ 1080us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:52.097561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:52.097586 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:52.097693 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.097699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098675 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.098681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.099860 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.099868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100734 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.100821 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.100840 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 06:17:52.100888 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 06:17:52.100962 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":217,"thread_start_us":94,"threads_started":1}
I20260807 06:17:52.101480 5757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.096502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35519 (local address 127.0.0.1:47038)
0807 06:17:52.096750 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.096763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:52.096837 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:52.097666 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:52.097671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:52.097692 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:52.097793 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.097800 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098708 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.098711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.099940 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:52.099949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100935 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.101078 (+ 143us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:52.101168 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.101191 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:17:52.101280 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 06:17:52.101358 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":50,"thread_start_us":94,"threads_started":1}
I20260807 06:17:52.101629 5365 tablet_service.cc:1467] Processing CreateTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 (DEFAULT_TABLE table=test-table [id=c5e8b97b7f2443629d23ece1b24802dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:52.101760 5758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.096648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34484 (local address 127.26.252.67:46265)
0807 06:17:52.097304 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:52.097308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:52.097322 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:17:52.097374 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:52.097377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:52.097427 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:52.097522 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:52.097826 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098541 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100001 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100605 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.101456 (+ 851us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.101517 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:52.101555 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 06:17:52.101625 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":69,"threads_started":1}
I20260807 06:17:52.101967 5365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073c2d1fe0c74154beab7fdbaca0a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:52.101971 5759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.096792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47038 (local address 127.26.252.65:35519)
0807 06:17:52.097352 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:52.097357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:52.097370 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:52.097417 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:52.097420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:52.097476 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:52.097556 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:52.097909 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.098589 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100078 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.100719 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.100815 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.100871 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:52.101750 (+ 879us) server_negotiation.cc:299] Negotiation successful
0807 06:17:52.101845 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":119,"threads_started":1}
I20260807 06:17:52.102275 5532 tablet_service.cc:1467] Processing CreateTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 (DEFAULT_TABLE table=test-table [id=c5e8b97b7f2443629d23ece1b24802dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:52.102470 5178 tablet_service.cc:1467] Processing CreateTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 (DEFAULT_TABLE table=test-table [id=c5e8b97b7f2443629d23ece1b24802dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:52.102589 5532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073c2d1fe0c74154beab7fdbaca0a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:52.102717 5178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 073c2d1fe0c74154beab7fdbaca0a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:52.104321 5760 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Bootstrap starting.
I20260807 06:17:52.105463 5761 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Bootstrap starting.
I20260807 06:17:52.105602 5760 tablet_bootstrap.cc:654] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:52.106390 5761 tablet_bootstrap.cc:654] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:52.106657 5762 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Bootstrap starting.
I20260807 06:17:52.106956 5760 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: No bootstrap required, opened a new log
I20260807 06:17:52.107056 5760 ts_tablet_manager.cc:1397] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:52.107498 5762 tablet_bootstrap.cc:654] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:52.107497 5760 raft_consensus.cc:348] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.107584 5760 raft_consensus.cc:374] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:52.107605 5760 raft_consensus.cc:729] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc35ffe8bba94add9f6f1748ee9c1aa1, State: Initialized, Role: FOLLOWER
I20260807 06:17:52.107703 5761 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: No bootstrap required, opened a new log
I20260807 06:17:52.107782 5761 ts_tablet_manager.cc:1397] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:52.107775 5760 consensus_queue.cc:260] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.108137 5760 ts_tablet_manager.cc:1428] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:52.108242 5761 raft_consensus.cc:348] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.108376 5761 raft_consensus.cc:374] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:52.108412 5761 raft_consensus.cc:729] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad494a1b227b4cb590b823660a5bdf24, State: Initialized, Role: FOLLOWER
I20260807 06:17:52.108536 5761 consensus_queue.cc:260] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.108901 5761 ts_tablet_manager.cc:1428] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:52.109606 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.109309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:48509)
0807 06:17:52.109463 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.109529 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 06:17:52.109755 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.109221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:43063)
0807 06:17:52.109602 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.109675 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298}
I20260807 06:17:52.111584 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.111343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:57177)
0807 06:17:52.111457 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.111516 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:17:52.111621 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.111330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:46571)
0807 06:17:52.111480 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.111545 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 06:17:52.111835 5449 heartbeater.cc:503] Master 127.26.252.124:46601 was elected leader, sending a full tablet report...
I20260807 06:17:52.112205 5618 heartbeater.cc:503] Master 127.26.252.124:46601 was elected leader, sending a full tablet report...
I20260807 06:17:52.113727 5762 tablet_bootstrap.cc:492] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b: No bootstrap required, opened a new log
I20260807 06:17:52.113842 5762 ts_tablet_manager.cc:1397] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 06:17:52.114331 5762 raft_consensus.cc:348] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.114468 5762 raft_consensus.cc:374] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:52.114511 5762 raft_consensus.cc:729] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2a5dbdafeb44a79b4c25ad2fab615b, State: Initialized, Role: FOLLOWER
I20260807 06:17:52.114647 5762 consensus_queue.cc:260] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.115015 5762 ts_tablet_manager.cc:1428] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260807 06:17:52.115537 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.115313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:53161)
0807 06:17:52.115407 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.115465 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 06:17:52.116202 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.115993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:42399)
0807 06:17:52.116083 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.116129 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 06:17:52.116779 5265 heartbeater.cc:503] Master 127.26.252.124:46601 was elected leader, sending a full tablet report...
I20260807 06:17:52.207325 5770 raft_consensus.cc:482] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:52.207499 5770 raft_consensus.cc:504] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.208101 5770 leader_election.cc:288] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353), 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:52.208681 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073c2d1fe0c74154beab7fdbaca0a257" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" is_pre_election: true
I20260807 06:17:52.208671 5204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073c2d1fe0c74154beab7fdbaca0a257" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" is_pre_election: true
I20260807 06:17:52.208863 5389 raft_consensus.cc:2454] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 0.
I20260807 06:17:52.208875 5204 raft_consensus.cc:2454] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 0.
I20260807 06:17:52.209306 5479 leader_election.cc:302] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a2a5dbdafeb44a79b4c25ad2fab615b, ad494a1b227b4cb590b823660a5bdf24; no voters:
I20260807 06:17:52.209491 5770 raft_consensus.cc:2781] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:52.209553 5770 raft_consensus.cc:482] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:52.209594 5770 raft_consensus.cc:3037] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:52.210834 5770 raft_consensus.cc:504] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.211170 5770 leader_election.cc:288] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 election: Requested vote from peers bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353), 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519)
I20260807 06:17:52.211608 5389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073c2d1fe0c74154beab7fdbaca0a257" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1"
I20260807 06:17:52.211763 5389 raft_consensus.cc:3037] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:52.211704 5204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "073c2d1fe0c74154beab7fdbaca0a257" candidate_uuid: "ad494a1b227b4cb590b823660a5bdf24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b"
I20260807 06:17:52.211890 5204 raft_consensus.cc:3037] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 0 FOLLOWER]: Advancing to term 1
W20260807 06:17:52.212508 5622 tablet.cc:2369] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:52.212812 5389 raft_consensus.cc:2454] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 1.
I20260807 06:17:52.213102 5204 raft_consensus.cc:2454] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad494a1b227b4cb590b823660a5bdf24 in term 1.
I20260807 06:17:52.213126 5479 leader_election.cc:302] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad494a1b227b4cb590b823660a5bdf24, bc35ffe8bba94add9f6f1748ee9c1aa1; no voters:
I20260807 06:17:52.213340 5770 raft_consensus.cc:2781] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:52.213617 5770 raft_consensus.cc:686] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 1 LEADER]: Becoming Leader. State: Replica: ad494a1b227b4cb590b823660a5bdf24, State: Running, Role: LEADER
I20260807 06:17:52.213801 5770 consensus_queue.cc:237] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } }
I20260807 06:17:52.214463 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.214107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:42105)
0807 06:17:52.214287 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.214352 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 06:17:52.215585 5023 catalog_manager.cc:5495] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "ad494a1b227b4cb590b823660a5bdf24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad494a1b227b4cb590b823660a5bdf24" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:52.255527 5758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.252580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34500 (local address 127.26.252.67:46265)
0807 06:17:52.252714 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:52.252718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:52.252764 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:17:52.252893 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:52.252895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:52.252940 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:52.253007 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:52.253234 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.253738 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.254625 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:52.254846 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:52.254921 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:52.255156 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:52.255222 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:52.255283 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:52.255370 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 06:17:52.255415 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 06:17:52.257864 5452 tablet.cc:2369] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:52.258014 5389 raft_consensus.cc:1261] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Refusing update from remote peer ad494a1b227b4cb590b823660a5bdf24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:52.258548 5204 raft_consensus.cc:1261] T 073c2d1fe0c74154beab7fdbaca0a257 P 0a2a5dbdafeb44a79b4c25ad2fab615b [term 1 FOLLOWER]: Refusing update from remote peer ad494a1b227b4cb590b823660a5bdf24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:52.258567 5770 consensus_queue.cc:1035] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc35ffe8bba94add9f6f1748ee9c1aa1" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:52.259016 5770 consensus_queue.cc:1035] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a2a5dbdafeb44a79b4c25ad2fab615b" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:52.261377 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.260999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:52449)
0807 06:17:52.261228 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.261301 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260807 06:17:52.261513 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.261044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:56407)
0807 06:17:52.261356 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.261409 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232}
I20260807 06:17:52.264101 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.263703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:38711)
0807 06:17:52.263953 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.264015 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260807 06:17:52.265334 5728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.264471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.66:59065)
0807 06:17:52.265192 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.265262 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":645}
I20260807 06:17:52.266402 5729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.266172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.67:36355)
0807 06:17:52.266275 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.266330 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 06:17:52.267413 5778 mvcc.cc:205] Tried to move back new op lower bound from 7315797902364151808 to 7315797902189277184. Current Snapshot: MvccSnapshot[applied={T|T < 7315797902364151808}]
I20260807 06:17:52.268319 5732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.267946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:43159 (local address 127.26.252.65:41217)
0807 06:17:52.268184 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.268239 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:43159: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
I20260807 06:17:52.270133 5023 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:52.270315 5023 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52150:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:52.274446 5023 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ed249c1cbcf64e68a4277c034eba17ef: Sending DeleteTablet for 3 replicas of tablet 073c2d1fe0c74154beab7fdbaca0a257
I20260807 06:17:52.275157 5365 tablet_service.cc:1514] Processing DeleteTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:52 UTC) from {username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:53090
I20260807 06:17:52.275226 5532 tablet_service.cc:1514] Processing DeleteTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:52 UTC) from {username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:34484
I20260807 06:17:52.275569 5788 tablet_replica.cc:330] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: stopping tablet replica
I20260807 06:17:52.275686 5178 tablet_service.cc:1514] Processing DeleteTablet for tablet 073c2d1fe0c74154beab7fdbaca0a257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:52 UTC) from {username='oryx', principal='oryx/127.26.252.124@KRBTEST.COM'} at 127.0.0.1:47038
I20260807 06:17:52.275724 5788 raft_consensus.cc:2229] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:52.275866 5788 raft_consensus.cc:2258] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:52.276196 5787 tablet_replica.cc:330] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: stopping tablet replica
I20260807 06:17:52.276243 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4972
I20260807 06:17:52.281836 5787 raft_consensus.cc:2229] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:52.282146 5788 ts_tablet_manager.cc:1905] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:52.282172 5787 raft_consensus.cc:2258] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:52.283133 5787 ts_tablet_manager.cc:1905] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:52.285629 5788 ts_tablet_manager.cc:1918] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:52.285743 5788 log.cc:1196] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/073c2d1fe0c74154beab7fdbaca0a257
I20260807 06:17:52.286120 5788 ts_tablet_manager.cc:1939] T 073c2d1fe0c74154beab7fdbaca0a257 P bc35ffe8bba94add9f6f1748ee9c1aa1: Deleting consensus metadata
I20260807 06:17:52.286324 5787 ts_tablet_manager.cc:1918] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:52.286437 5787 log.cc:1196] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/073c2d1fe0c74154beab7fdbaca0a257
I20260807 06:17:52.286790 5787 ts_tablet_manager.cc:1939] T 073c2d1fe0c74154beab7fdbaca0a257 P ad494a1b227b4cb590b823660a5bdf24: Deleting consensus metadata
I20260807 06:17:52.287599 5003 catalog_manager.cc:4841] TS ad494a1b227b4cb590b823660a5bdf24 (127.26.252.67:46265): tablet 073c2d1fe0c74154beab7fdbaca0a257 (table test-table [id=c5e8b97b7f2443629d23ece1b24802dd]) successfully deleted
I20260807 06:17:52.289386 5005 catalog_manager.cc:4841] TS bc35ffe8bba94add9f6f1748ee9c1aa1 (127.26.252.66:43353): tablet 073c2d1fe0c74154beab7fdbaca0a257 (table test-table [id=c5e8b97b7f2443629d23ece1b24802dd]) successfully deleted
I20260807 06:17:52.295919 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 5280
I20260807 06:17:52.296262 5757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:52.295884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35519 (local address 127.0.0.1:47040)
0807 06:17:52.296037 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:52.296158 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 06:17:52.301064 5005 catalog_manager.cc:4584] TS 0a2a5dbdafeb44a79b4c25ad2fab615b (127.26.252.65:35519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 073c2d1fe0c74154beab7fdbaca0a257: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35519: connect: Connection refused (error 111)
I20260807 06:17:52.306851 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 5456
I20260807 06:17:52.325542 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4582
I20260807 06:17:52.336293 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 4723
2026-08-07T06:17:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7261 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:52 dist-test-slave-68xk krb5kdc[5793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:52 dist-test-slave-68xk krb5kdc[5793](info): set up 2 sockets
Aug 07 06:17:52 dist-test-slave-68xk krb5kdc[5793](info): commencing operation
krb5kdc: starting...
W20260807 06:17:53.634714 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:53 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab.
Entry for principal oryx/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab.
I20260807 06:17:53.767164 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39691
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab
--principal=oryx/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:39691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:53.881311 5808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:53.881564 5808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:53.881604 5808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:53.885622 5808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:53.885674 5808 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:17:53.885691 5808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:53.885710 5808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:53.885732 5808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:53.885748 5808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:53.890822 5808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:39691
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.126.keytab
--principal=oryx/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:53.891782 5808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:53.892856 5808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:53.902098 5819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:53.902118 5823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:53.902144 5818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:53.903297 5808 server_base.cc:1034] running on GCE node
I20260807 06:17:53.903891 5808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:53.905085 5808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:53.906255 5808 hybrid_clock.cc:648] HybridClock initialized: now 1786083473906226 us; error 44 us; skew 500 ppm
Aug 07 06:17:53 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083473, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:53.909121 5808 init.cc:377] Logged in from keytab as oryx/127.26.252.126@KRBTEST.COM (short username oryx)
I20260807 06:17:53.910050 5808 webserver.cc:460] Webserver started at http://127.26.252.126:33977/ using document root <none> and password file <none>
I20260807 06:17:53.910693 5808 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:53.910804 5808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:53.911052 5808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:53.913142 5808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "c7cfd598e0d646c8adea49e6a29df315"
format_stamp: "Formatted at 2026-08-07 06:17:53 on dist-test-slave-68xk"
server_key: "91b8788d81113e821c33a2bcff83f246"
server_key_iv: "9050542c691bede0512e4e858e6d7bf9"
server_key_version: "encryptionkey@0"
I20260807 06:17:53.913828 5808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "c7cfd598e0d646c8adea49e6a29df315"
format_stamp: "Formatted at 2026-08-07 06:17:53 on dist-test-slave-68xk"
server_key: "91b8788d81113e821c33a2bcff83f246"
server_key_iv: "9050542c691bede0512e4e858e6d7bf9"
server_key_version: "encryptionkey@0"
I20260807 06:17:53.917586 5808 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:53.920037 5833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:53.921216 5808 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:53.921365 5808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "c7cfd598e0d646c8adea49e6a29df315"
format_stamp: "Formatted at 2026-08-07 06:17:53 on dist-test-slave-68xk"
server_key: "91b8788d81113e821c33a2bcff83f246"
server_key_iv: "9050542c691bede0512e4e858e6d7bf9"
server_key_version: "encryptionkey@0"
I20260807 06:17:53.921476 5808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:53.933960 5808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:53.936899 5808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:53.937109 5808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:53.945785 5808 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:39691
I20260807 06:17:53.945797 5909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:39691 every 8 connection(s)
I20260807 06:17:53.946810 5808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:53.949766 5910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:53.954092 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 5808
I20260807 06:17:53.954264 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:53.954624 27633 external_mini_cluster.cc:1428] Setting key bb9252a7ab3b14a836198896d5a9d86c
I20260807 06:17:53.956553 5910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Bootstrap starting.
I20260807 06:17:53.959367 5910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:53.960253 5910 log.cc:824] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:53.962677 5910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: No bootstrap required, opened a new log
Aug 07 06:17:53 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:53.967739 5910 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } }
I20260807 06:17:53.968072 5910 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:53.968144 5910 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cfd598e0d646c8adea49e6a29df315, State: Initialized, Role: FOLLOWER
I20260807 06:17:53.968807 5910 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } }
I20260807 06:17:53.968990 5910 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:53.969069 5910 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:53.969220 5910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:53.970170 5910 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } }
I20260807 06:17:53.970350 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:53.956027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34672 (local address 127.26.252.126:39691)
0807 06:17:53.956477 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:53.956494 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:53.956529 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:17:53.957237 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:53.957257 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:53.957582 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:53.957871 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:53.958950 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:53.960027 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:53.961200 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:53.961663 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:53.961790 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:53.964914 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:53.964921 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:53.964942 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:53.964979 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:53.967234 (+ 2255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:53.967664 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:53.967670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:53.967676 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:53.967837 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:53.968116 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:53.968119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:53.968121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:53.968745 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:53.968983 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:53.969282 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 06:17:53.969604 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":170,"threads_started":1}
I20260807 06:17:53.970644 5910 leader_election.cc:302] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7cfd598e0d646c8adea49e6a29df315; no voters:
I20260807 06:17:53.971021 5910 leader_election.cc:288] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:53.971124 5916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:53.971339 5916 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [term 1 LEADER]: Becoming Leader. State: Replica: c7cfd598e0d646c8adea49e6a29df315, State: Running, Role: LEADER
I20260807 06:17:53.971724 5916 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } }
I20260807 06:17:53.972419 5910 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:53.973133 5921 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7cfd598e0d646c8adea49e6a29df315. Latest consensus state: current_term: 1 leader_uuid: "c7cfd598e0d646c8adea49e6a29df315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } } }
I20260807 06:17:53.973390 5921 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:53.973518 5918 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7cfd598e0d646c8adea49e6a29df315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cfd598e0d646c8adea49e6a29df315" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39691 } } }
I20260807 06:17:53.973634 5918 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:53.973910 5929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:53.977510 5929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:53.983561 5929 catalog_manager.cc:1347] Generated new cluster ID: 254de814ee554ceabaa5442716bfdc47
I20260807 06:17:53.983626 5929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:54.002314 5929 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:54.003530 5929 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:54.007781 5929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Generated new TSK 0
I20260807 06:17:54.008540 5929 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
I20260807 06:17:54.046274 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39691
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:54.162387 5944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:54.162752 5944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:54.162825 5944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:54.166847 5944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:54.166922 5944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:54.166985 5944 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:54.167062 5944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:54.172317 5944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:39691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:54.173631 5944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:54.174862 5944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:54.184619 5950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:54.184677 5949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:54.184619 5952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:54.184830 5944 server_base.cc:1034] running on GCE node
I20260807 06:17:54.185410 5944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:54.186102 5944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:54.187305 5944 hybrid_clock.cc:648] HybridClock initialized: now 1786083474187285 us; error 32 us; skew 500 ppm
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:54.190184 5944 init.cc:377] Logged in from keytab as oryx/127.26.252.65@KRBTEST.COM (short username oryx)
I20260807 06:17:54.191162 5944 webserver.cc:460] Webserver started at http://127.26.252.65:34711/ using document root <none> and password file <none>
I20260807 06:17:54.191766 5944 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:54.191882 5944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:54.192121 5944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:54.194188 5944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "3e0565250a864081a7479817fe8e3924"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "d0e200b7b4850caedc54f5d9b7960893"
server_key_iv: "105b9f23b0d91415a324e4e19e3a7b5e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.194829 5944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "3e0565250a864081a7479817fe8e3924"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "d0e200b7b4850caedc54f5d9b7960893"
server_key_iv: "105b9f23b0d91415a324e4e19e3a7b5e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.198619 5944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:17:54.201331 5964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.202847 5944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:54.202993 5944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "3e0565250a864081a7479817fe8e3924"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "d0e200b7b4850caedc54f5d9b7960893"
server_key_iv: "105b9f23b0d91415a324e4e19e3a7b5e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.203115 5944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:54.223485 5944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:54.226890 5944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:54.227109 5944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:54.228701 5944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:54.228776 5944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.228852 5944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:54.228904 5944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:54.240300 5944 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:45331
I20260807 06:17:54.240360 6113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:45331 every 8 connection(s)
I20260807 06:17:54.241354 5944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:54.242974 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.229551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:55431 (local address 127.26.252.126:39691)
0807 06:17:54.229735 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.229742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.230585 (+ 843us) server_negotiation.cc:407] Connection header received
0807 06:17:54.231543 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.231546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.231605 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.231693 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.233161 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.234062 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.235575 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.235830 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.235961 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.239067 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.239071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.239074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.239108 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.240764 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.241330 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.241333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.241334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.241408 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.241814 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.241821 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.241826 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.242080 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.242188 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.242734 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.242854 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:17:54.243854 5977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.229932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.65:55431)
0807 06:17:54.230380 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.230471 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.231326 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.231989 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.231997 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.232401 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.232984 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.233000 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.234220 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.234223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.235447 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.235458 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.236018 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.236025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.236263 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.236933 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.236959 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.238876 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.240877 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.240883 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.240895 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.241219 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.241506 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.241509 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.241511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.241655 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.242182 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.242190 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.242474 (+ 284us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.242646 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.242883 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":130,"threads_started":1}
I20260807 06:17:54.243875 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 5944
I20260807 06:17:54.243999 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:54.244326 27633 external_mini_cluster.cc:1428] Setting key fac82a9d9eaf2684f67edff39dbc22b9
I20260807 06:17:54.245468 6114 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39691
I20260807 06:17:54.245638 6114 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:54.246258 6114 heartbeater.cc:511] Master 127.26.252.126:39691 requested a full tablet report, sending...
I20260807 06:17:54.248055 5851 ts_manager.cc:194] Registered new tserver with Master: 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331)
I20260807 06:17:54.249313 5851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:55431
I20260807 06:17:54.256330 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.248042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39471 (local address 127.26.252.126:39691)
0807 06:17:54.248781 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.248790 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.248808 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:17:54.248854 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.248860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.248914 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.249017 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.249533 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.250264 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.251448 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.251687 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.251803 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.253143 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.253146 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.253147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.253168 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.254688 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.255183 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.255186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.255187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.255260 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.255569 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.255571 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.255572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.255724 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.255811 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.256127 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.256217 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619}
I20260807 06:17:54.256515 6122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.247629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.65:39471)
0807 06:17:54.247972 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.247988 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.248074 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.249056 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.249059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.249264 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.249389 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.249401 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.250604 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.250606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.251326 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.251335 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.251806 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.251810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.251901 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.252482 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.252502 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.252990 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.254802 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.254805 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.254808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.255076 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.255361 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.255365 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.255369 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.255468 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.255837 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.255840 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.255955 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.256088 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.256240 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":24,"thread_start_us":137,"threads_started":1}
WARNING: no policy specified for oryx/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
I20260807 06:17:54.277526 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39691
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:54.390264 6129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:54.390535 6129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:54.390581 6129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:54.394452 6129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:54.394520 6129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:54.394560 6129 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:54.394591 6129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:54.399605 6129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:39691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:54.400545 6129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:54.401492 6129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:54.411731 6141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:54.411746 6138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:54.411823 6137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:54.412233 6129 server_base.cc:1034] running on GCE node
I20260807 06:17:54.412569 6129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:54.413189 6129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:54.414350 6129 hybrid_clock.cc:648] HybridClock initialized: now 1786083474414312 us; error 51 us; skew 500 ppm
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:54.417095 6129 init.cc:377] Logged in from keytab as oryx/127.26.252.66@KRBTEST.COM (short username oryx)
I20260807 06:17:54.417999 6129 webserver.cc:460] Webserver started at http://127.26.252.66:41873/ using document root <none> and password file <none>
I20260807 06:17:54.418627 6129 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:54.418692 6129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:54.418939 6129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:54.420923 6129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "b445e9b0c6ea46cc9955a0061696229a"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "9e65f1ebed819105282a7c0e152e3019"
server_key_iv: "3c92c630ec6befda6cfe027a40252bff"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.421479 6129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "b445e9b0c6ea46cc9955a0061696229a"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "9e65f1ebed819105282a7c0e152e3019"
server_key_iv: "3c92c630ec6befda6cfe027a40252bff"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.425107 6129 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:17:54.427590 6149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.428767 6129 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:54.428890 6129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "b445e9b0c6ea46cc9955a0061696229a"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "9e65f1ebed819105282a7c0e152e3019"
server_key_iv: "3c92c630ec6befda6cfe027a40252bff"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.428993 6129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:54.450834 6129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:54.453908 6129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:54.454121 6129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:54.455657 6129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:54.455708 6129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.455749 6129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:54.455765 6129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:54.466578 6129 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:39495
I20260807 06:17:54.466651 6305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:39495 every 8 connection(s)
I20260807 06:17:54.467674 6129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:54.470805 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.456389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:42463 (local address 127.26.252.126:39691)
0807 06:17:54.456566 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.456575 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.457396 (+ 821us) server_negotiation.cc:407] Connection header received
0807 06:17:54.458430 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.458434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.458496 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.458554 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.460455 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.461347 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.463086 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.463488 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.463621 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.466388 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.466397 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.466400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.466463 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.467963 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.468526 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.468533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.468535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.468620 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.468975 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.468978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.468979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.469159 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.469277 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.470550 (+ 1273us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.470667 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:17:54.471006 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.456772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.66:42463)
0807 06:17:54.457215 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.457275 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.458126 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.459060 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.459069 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.459606 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.460273 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.460296 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.461492 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.461496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.462952 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.462962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.463652 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.463655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.463797 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.464425 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.464446 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.466185 (+ 1739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.468087 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.468092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.468107 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.468434 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.468715 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.468719 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.468721 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.468866 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.469267 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.469273 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.469507 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.469732 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.470090 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":130,"threads_started":1}
I20260807 06:17:54.472307 6306 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39691
I20260807 06:17:54.472502 6306 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:54.473114 6306 heartbeater.cc:511] Master 127.26.252.126:39691 requested a full tablet report, sending...
I20260807 06:17:54.474474 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 6129
I20260807 06:17:54.474570 5852 ts_manager.cc:194] Registered new tserver with Master: b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495)
I20260807 06:17:54.474601 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:54.474988 27633 external_mini_cluster.cc:1428] Setting key b44fdbc1c7abbb2f020056243f041a33
I20260807 06:17:54.475286 5852 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:42463
I20260807 06:17:54.483057 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.474683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:42093 (local address 127.26.252.126:39691)
0807 06:17:54.474812 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.474817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.475099 (+ 282us) server_negotiation.cc:407] Connection header received
0807 06:17:54.475219 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.475221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.475271 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.475360 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.476132 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.476898 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.477877 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.478323 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.478496 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.479749 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.479751 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.479753 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.479775 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.481093 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.481708 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.481714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.481715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.481813 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.482132 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.482134 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.482135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.482363 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.482539 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.482858 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.482949 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:54.483224 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.474585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.66:42093)
0807 06:17:54.474984 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.475002 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.475125 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.475622 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.475627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.475874 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.476016 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.476025 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.477053 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.477056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.477722 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.477731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.478486 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.478492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.478566 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.479109 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.479129 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.479577 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.481226 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.481232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.481238 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.481568 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.481920 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.481926 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.481928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.482036 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.482548 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.482554 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.482668 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.482794 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.482958 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for oryx/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
I20260807 06:17:54.505934 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39691
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:54.620687 6321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:54.620931 6321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:54.620973 6321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:54.625025 6321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:54.625102 6321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:54.625171 6321 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:17:54.625257 6321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:54.630378 6321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.252.126:39691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:54.631434 6321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:54.632452 6321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:54.642561 6330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:54.642656 6327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:54.642959 6321 server_base.cc:1034] running on GCE node
W20260807 06:17:54.642561 6328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:54.643461 6321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:54.644076 6321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:54.645295 6321 hybrid_clock.cc:648] HybridClock initialized: now 1786083474645265 us; error 45 us; skew 500 ppm
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:54.648409 6321 init.cc:377] Logged in from keytab as oryx/127.26.252.67@KRBTEST.COM (short username oryx)
I20260807 06:17:54.649364 6321 webserver.cc:460] Webserver started at http://127.26.252.67:45759/ using document root <none> and password file <none>
I20260807 06:17:54.649984 6321 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:54.650086 6321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:54.650368 6321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:54.652697 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "6140d6eadd264fff8a604be67d1b02b3"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "b5bb6d6f978e7504790c7ae0ad0c2599"
server_key_iv: "86f49a797898d6351335fc14c7f4869e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.653331 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "6140d6eadd264fff8a604be67d1b02b3"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "b5bb6d6f978e7504790c7ae0ad0c2599"
server_key_iv: "86f49a797898d6351335fc14c7f4869e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.657418 6321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 06:17:54.660166 6339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.661437 6321 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:54.661587 6321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "6140d6eadd264fff8a604be67d1b02b3"
format_stamp: "Formatted at 2026-08-07 06:17:54 on dist-test-slave-68xk"
server_key: "b5bb6d6f978e7504790c7ae0ad0c2599"
server_key_iv: "86f49a797898d6351335fc14c7f4869e"
server_key_version: "encryptionkey@0"
I20260807 06:17:54.661713 6321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:54.692426 6321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:54.695863 6321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:54.696205 6321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:54.697855 6321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:54.697942 6321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:54.698030 6321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:54.698092 6321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:54.711124 6321 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:40533
I20260807 06:17:54.711184 6491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:40533 every 8 connection(s)
I20260807 06:17:54.712389 6321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:54.712829 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 6321
I20260807 06:17:54.712983 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:54.713326 27633 external_mini_cluster.cc:1428] Setting key 9f914745bda45f2e532650ca87260fb3
I20260807 06:17:54.714118 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.698973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:39583 (local address 127.26.252.126:39691)
0807 06:17:54.699150 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.699155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.700225 (+ 1070us) server_negotiation.cc:407] Connection header received
0807 06:17:54.701355 (+ 1130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.701358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.701416 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.701480 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.703024 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.703733 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.705020 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.705405 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.705523 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.709577 (+ 4054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.709581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.709584 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.709612 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.711528 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.712031 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.712035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.712037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.712140 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.712639 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.712650 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.712652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.712938 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.713044 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.713747 (+ 703us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.713934 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:17:54.715039 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.699521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.67:39583)
0807 06:17:54.700056 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.700105 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.701077 (+ 972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.701916 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.701923 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.702253 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.702874 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.702887 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.703882 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.703885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.704898 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.704908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.705567 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.705571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.705760 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.706458 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.706486 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.709390 (+ 2904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.711649 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.711653 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.711665 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.711915 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.712281 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.712284 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.712285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.712501 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.713108 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.713118 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.713446 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.713702 (+ 256us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.714066 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":158,"threads_started":1}
I20260807 06:17:54.716429 6492 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39691
I20260807 06:17:54.716573 6492 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:54.717114 6492 heartbeater.cc:511] Master 127.26.252.126:39691 requested a full tablet report, sending...
I20260807 06:17:54.718298 5851 ts_manager.cc:194] Registered new tserver with Master: 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:54.719107 5851 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:39583
I20260807 06:17:54.726431 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.718910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:54861 (local address 127.26.252.126:39691)
0807 06:17:54.719048 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.719052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.719514 (+ 462us) server_negotiation.cc:407] Connection header received
0807 06:17:54.719619 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.719622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.719687 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.719782 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.720286 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.720829 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.721713 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.721935 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.722022 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.723173 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.723176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.723178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.723200 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.724493 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.725013 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.725017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.725019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.725147 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.725491 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.725494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.725496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.725692 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.725811 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.726110 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.726229 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:17:54.726459 6500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.718839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.26.252.67:54861)
0807 06:17:54.719444 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.719457 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.719538 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.719819 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.719822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.720039 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:54.720147 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.720154 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.720970 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.720973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.721599 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.721608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.722041 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.722043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.722113 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.722701 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:54.722713 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:54.723039 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:54.724637 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.724642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.724645 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.724894 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.725275 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:54.725278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:54.725280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:54.725373 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:54.725803 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:54.725807 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:54.725914 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.726047 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.726216 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":107,"threads_started":1}
I20260807 06:17:54.728263 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:17:54.755175 5914 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:54.748537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34688 (local address 127.26.252.126:39691)
0807 06:17:54.748693 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.748697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.748712 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:54.748763 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.748766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.748808 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.748885 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.749647 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.750179 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.751119 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.751361 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.751448 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.755005 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34688: BlockingRecv error: recv got EOF from 127.0.0.1:34688 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 06:17:54 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083474, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:54.766013 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.756658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34694 (local address 127.26.252.126:39691)
0807 06:17:54.756799 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.756803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.756902 (+ 99us) server_negotiation.cc:407] Connection header received
0807 06:17:54.757037 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.757039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.757076 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.757143 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:54.757806 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.758313 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.759217 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.759494 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.759597 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.762260 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:54.762263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:54.762266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:54.762292 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:54.764033 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.764531 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.764534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.764536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.764620 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:54.765018 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:54.765021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:54.765023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:54.765218 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:54.765375 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.765655 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.765799 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:17:54.769598 5851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:54.773092 5851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:54.788301 6525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.781636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:39495 (local address 127.0.0.1:60660)
0807 06:17:54.782487 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.782501 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.782577 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.783868 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.783874 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.783901 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:54.784016 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.784023 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.785346 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.785350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.786717 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.786728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.787616 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.787621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.787756 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.787803 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.788007 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.788138 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":47,"thread_start_us":126,"threads_started":1}
I20260807 06:17:54.788347 6531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.782575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60660 (local address 127.26.252.66:39495)
0807 06:17:54.782948 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.782959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.782977 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:17:54.783487 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.783494 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.783690 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.783859 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:54.784149 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.785228 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.786860 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.787473 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.787625 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.787812 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.788066 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.788183 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":134,"threads_started":1}
I20260807 06:17:54.788686 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.781732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56006 (local address 127.26.252.65:45331)
0807 06:17:54.782787 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.782797 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.782823 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:17:54.782905 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.782910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.783120 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.783672 (+ 552us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:54.783823 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.784983 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.786824 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.787605 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.787704 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.787846 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.788453 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.788551 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":918,"thread_start_us":90,"threads_started":1}
I20260807 06:17:54.788345 6527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.781602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:45331 (local address 127.0.0.1:56006)
0807 06:17:54.782262 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.782314 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.782466 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.783311 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.783318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.783348 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:54.783514 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.783521 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.785128 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.785132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.786701 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.786711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.787910 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.787914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.788069 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.788094 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.788162 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.788226 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":171,"thread_start_us":91,"threads_started":1}
I20260807 06:17:54.789412 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.782348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40533 (local address 127.0.0.1:35620)
0807 06:17:54.783208 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.783225 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.783328 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.784106 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.784109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.784129 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:54.784211 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.784215 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.785308 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.785313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.787822 (+ 2509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.787832 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.788997 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.789000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.789114 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.789147 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.789209 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.789287 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":783,"mutex_wait_us":133,"thread_start_us":143,"threads_started":1}
I20260807 06:17:54.789634 6534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.783000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35620 (local address 127.26.252.67:40533)
0807 06:17:54.783527 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.783536 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.783555 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:17:54.783619 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.783623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.783774 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.783956 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:54.784332 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.785177 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.787973 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.788882 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.789010 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.789316 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.789372 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.789466 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":180,"threads_started":1}
I20260807 06:17:54.791885 6220 tablet_service.cc:1467] Processing CreateTablet for tablet 9eedc54c1a8146e884aae0c90e36232b (DEFAULT_TABLE table=test-table [id=f6dbca51fe2843d59c53c358891d3bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.792225 6031 tablet_service.cc:1467] Processing CreateTablet for tablet 9eedc54c1a8146e884aae0c90e36232b (DEFAULT_TABLE table=test-table [id=f6dbca51fe2843d59c53c358891d3bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.792372 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 9eedc54c1a8146e884aae0c90e36232b (DEFAULT_TABLE table=test-table [id=f6dbca51fe2843d59c53c358891d3bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.793144 6220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eedc54c1a8146e884aae0c90e36232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.793344 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eedc54c1a8146e884aae0c90e36232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.793340 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9eedc54c1a8146e884aae0c90e36232b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.800150 6535 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Bootstrap starting.
I20260807 06:17:54.801853 6537 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Bootstrap starting.
I20260807 06:17:54.802606 6535 tablet_bootstrap.cc:654] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.802796 6536 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Bootstrap starting.
I20260807 06:17:54.803561 6535 log.cc:824] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:54.804028 6537 tablet_bootstrap.cc:654] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.804853 6536 tablet_bootstrap.cc:654] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.804870 6537 log.cc:824] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:54.805658 6536 log.cc:824] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:54.806183 6535 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: No bootstrap required, opened a new log
I20260807 06:17:54.806466 6535 ts_tablet_manager.cc:1397] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.003s
I20260807 06:17:54.807137 6537 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: No bootstrap required, opened a new log
I20260807 06:17:54.807320 6537 ts_tablet_manager.cc:1397] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 06:17:54.807945 6536 tablet_bootstrap.cc:492] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: No bootstrap required, opened a new log
I20260807 06:17:54.808115 6536 ts_tablet_manager.cc:1397] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:17:54.810663 6535 raft_consensus.cc:348] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.810963 6535 raft_consensus.cc:374] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.811029 6535 raft_consensus.cc:729] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0565250a864081a7479817fe8e3924, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.811204 6537 raft_consensus.cc:348] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.811453 6537 raft_consensus.cc:374] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.811512 6537 raft_consensus.cc:729] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.811563 6535 consensus_queue.cc:260] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.811935 6537 consensus_queue.cc:260] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.811915 6536 raft_consensus.cc:348] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.812162 6536 raft_consensus.cc:374] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.812234 6536 raft_consensus.cc:729] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.812459 6114 heartbeater.cc:503] Master 127.26.252.126:39691 was elected leader, sending a full tablet report...
I20260807 06:17:54.812666 6535 ts_tablet_manager.cc:1428] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260807 06:17:54.812693 6536 consensus_queue.cc:260] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.812896 6537 ts_tablet_manager.cc:1428] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260807 06:17:54.813247 6306 heartbeater.cc:503] Master 127.26.252.126:39691 was elected leader, sending a full tablet report...
I20260807 06:17:54.813391 6492 heartbeater.cc:503] Master 127.26.252.126:39691 was elected leader, sending a full tablet report...
I20260807 06:17:54.816350 6536 ts_tablet_manager.cc:1428] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 06:17:54.913272 6545 raft_consensus.cc:482] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:54.913578 6545 raft_consensus.cc:504] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.914902 6545 leader_election.cc:288] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495)
I20260807 06:17:54.918824 6531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.915334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:51243 (local address 127.26.252.66:39495)
0807 06:17:54.915461 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.915468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.915485 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:17:54.915673 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.915676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.915727 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.915813 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:54.916078 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.916601 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.917779 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.918193 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.918327 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.918384 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.918620 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.918697 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:54.918824 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.915193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:39495 (local address 127.26.252.67:51243)
0807 06:17:54.915416 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.915432 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.915536 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.915826 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.915829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.915846 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:54.915966 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.915972 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.916727 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.916729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.917624 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.917635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.918327 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.918331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.918468 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.918497 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.918603 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.918683 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 06:17:54.919472 6245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eedc54c1a8146e884aae0c90e36232b" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e9b0c6ea46cc9955a0061696229a" is_pre_election: true
I20260807 06:17:54.919554 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.915194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:45331 (local address 127.26.252.67:52015)
0807 06:17:54.915647 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:54.915659 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:54.915823 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:54.916099 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:54.916101 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:54.916117 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:54.916544 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.916551 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.917422 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.917429 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.918250 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:54.918259 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.919134 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.919138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:54.919240 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.919257 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 06:17:54.919344 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 06:17:54.919411 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":56,"thread_start_us":144,"threads_started":1}
I20260807 06:17:54.919560 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.915282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:52015 (local address 127.26.252.65:45331)
0807 06:17:54.915449 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.915453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.915750 (+ 297us) server_negotiation.cc:407] Connection header received
0807 06:17:54.915953 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.915956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.915999 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.916085 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:54.916726 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.917306 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.918379 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.918840 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.918992 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.919051 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.919374 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.919455 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:17:54.919836 6245 raft_consensus.cc:2454] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 0.
I20260807 06:17:54.920244 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eedc54c1a8146e884aae0c90e36232b" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924" is_pre_election: true
I20260807 06:17:54.920389 6343 leader_election.cc:302] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6140d6eadd264fff8a604be67d1b02b3, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:54.920540 6057 raft_consensus.cc:2454] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 0.
I20260807 06:17:54.920693 6545 raft_consensus.cc:2781] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:54.920806 6545 raft_consensus.cc:482] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:54.920871 6545 raft_consensus.cc:3037] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:54.921972 6545 raft_consensus.cc:504] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.922323 6545 leader_election.cc:288] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495)
I20260807 06:17:54.922739 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eedc54c1a8146e884aae0c90e36232b" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924"
I20260807 06:17:54.922784 6245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9eedc54c1a8146e884aae0c90e36232b" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e9b0c6ea46cc9955a0061696229a"
I20260807 06:17:54.922888 6057 raft_consensus.cc:3037] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:54.922910 6245 raft_consensus.cc:3037] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:54.923929 6057 raft_consensus.cc:2454] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 1.
I20260807 06:17:54.924050 6245 raft_consensus.cc:2454] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 1.
I20260807 06:17:54.924286 6342 leader_election.cc:302] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, 6140d6eadd264fff8a604be67d1b02b3; no voters:
I20260807 06:17:54.924522 6545 raft_consensus.cc:2781] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:54.924793 6545 raft_consensus.cc:686] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 1 LEADER]: Becoming Leader. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Running, Role: LEADER
I20260807 06:17:54.925360 6545 consensus_queue.cc:237] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.928725 5850 catalog_manager.cc:5495] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "6140d6eadd264fff8a604be67d1b02b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } health_report { overall_health: HEALTHY } } }
I20260807 06:17:54.940347 6534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:54.936854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35636 (local address 127.26.252.67:40533)
0807 06:17:54.936978 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:54.936981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:54.936994 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:54.937104 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:54.937106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:54.937158 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:54.937256 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:54.937489 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.937997 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.938894 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:54.939106 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:54.939186 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:54.939434 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:54.939845 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:54.939932 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:54.940056 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 06:17:54.940110 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:17:54.946324 6245 raft_consensus.cc:1261] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Refusing update from remote peer 6140d6eadd264fff8a604be67d1b02b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:54.946324 6057 raft_consensus.cc:1261] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Refusing update from remote peer 6140d6eadd264fff8a604be67d1b02b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:54.947075 6545 consensus_queue.cc:1035] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:54.947285 6549 consensus_queue.cc:1035] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:54.955068 6553 mvcc.cc:205] Tried to move back new op lower bound from 7315797913372274688 to 7315797913297346560. Current Snapshot: MvccSnapshot[applied={T|T < 7315797913372274688}]
I20260807 06:17:54.955910 6554 mvcc.cc:205] Tried to move back new op lower bound from 7315797913372274688 to 7315797913297346560. Current Snapshot: MvccSnapshot[applied={T|T < 7315797913372274688}]
I20260807 06:17:54.966909 5851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:54.967101 5851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:54.969901 5851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Sending DeleteTablet for 3 replicas of tablet 9eedc54c1a8146e884aae0c90e36232b
I20260807 06:17:54.971102 6220 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eedc54c1a8146e884aae0c90e36232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:54 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 06:17:54.971135 6031 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eedc54c1a8146e884aae0c90e36232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:54 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:56006
I20260807 06:17:54.970870 6406 tablet_service.cc:1514] Processing DeleteTablet for tablet 9eedc54c1a8146e884aae0c90e36232b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:54 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:35620
I20260807 06:17:54.971832 6563 tablet_replica.cc:330] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: stopping tablet replica
I20260807 06:17:54.971876 5851 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 06:17:54.972239 6563 raft_consensus.cc:2229] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:54.972379 6564 tablet_replica.cc:330] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: stopping tablet replica
I20260807 06:17:54.972563 6562 tablet_replica.cc:330] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: stopping tablet replica
I20260807 06:17:54.972568 6563 raft_consensus.cc:2258] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 06:17:54.972595 5851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:54.972949 6564 raft_consensus.cc:2229] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:54.973603 6562 raft_consensus.cc:2229] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:54.973928 6562 raft_consensus.cc:2258] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:54.974378 6563 ts_tablet_manager.cc:1905] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:54.974319 6564 raft_consensus.cc:2258] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:54.977985 6031 tablet_service.cc:1467] Processing CreateTablet for tablet 7f577517d04748dcbef3650889e26f76 (DEFAULT_TABLE table=test-table [id=64f530de098547f0ba7378bfc08b7c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.978116 6220 tablet_service.cc:1467] Processing CreateTablet for tablet 7f577517d04748dcbef3650889e26f76 (DEFAULT_TABLE table=test-table [id=64f530de098547f0ba7378bfc08b7c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.978315 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f577517d04748dcbef3650889e26f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.978377 6220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f577517d04748dcbef3650889e26f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.978741 6563 ts_tablet_manager.cc:1918] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:54.978839 6563 log.cc:1196] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/9eedc54c1a8146e884aae0c90e36232b
I20260807 06:17:54.979187 6563 ts_tablet_manager.cc:1939] T 9eedc54c1a8146e884aae0c90e36232b P b445e9b0c6ea46cc9955a0061696229a: Deleting consensus metadata
I20260807 06:17:54.980573 6537 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Bootstrap starting.
I20260807 06:17:54.981185 6535 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Bootstrap starting.
I20260807 06:17:54.981704 6537 tablet_bootstrap.cc:654] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.982156 6535 tablet_bootstrap.cc:654] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.982626 5837 catalog_manager.cc:4841] TS b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495): tablet 9eedc54c1a8146e884aae0c90e36232b (table test-table [id=f6dbca51fe2843d59c53c358891d3bd8]) successfully deleted
I20260807 06:17:54.982959 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 7f577517d04748dcbef3650889e26f76 (DEFAULT_TABLE table=test-table [id=64f530de098547f0ba7378bfc08b7c57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:54.983273 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f577517d04748dcbef3650889e26f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:54.983798 6537 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: No bootstrap required, opened a new log
I20260807 06:17:54.983876 6535 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: No bootstrap required, opened a new log
I20260807 06:17:54.983891 6537 ts_tablet_manager.cc:1397] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 06:17:54.983956 6535 ts_tablet_manager.cc:1397] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:54.984079 6562 ts_tablet_manager.cc:1905] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:54.984381 6537 raft_consensus.cc:348] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.984440 6535 raft_consensus.cc:348] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.984508 6537 raft_consensus.cc:374] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.984544 6537 raft_consensus.cc:729] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.984547 6535 raft_consensus.cc:374] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.984614 6535 raft_consensus.cc:729] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0565250a864081a7479817fe8e3924, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.984704 6537 consensus_queue.cc:260] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.984740 6535 consensus_queue.cc:260] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.984992 6537 ts_tablet_manager.cc:1428] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:17:54.985967 6536 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Bootstrap starting.
I20260807 06:17:54.986690 6535 ts_tablet_manager.cc:1428] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260807 06:17:54.986769 6562 ts_tablet_manager.cc:1918] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:54.986878 6562 log.cc:1196] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/9eedc54c1a8146e884aae0c90e36232b
I20260807 06:17:54.987061 6536 tablet_bootstrap.cc:654] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:54.987723 6562 ts_tablet_manager.cc:1939] T 9eedc54c1a8146e884aae0c90e36232b P 3e0565250a864081a7479817fe8e3924: Deleting consensus metadata
I20260807 06:17:54.988584 6536 tablet_bootstrap.cc:492] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: No bootstrap required, opened a new log
I20260807 06:17:54.988677 6536 ts_tablet_manager.cc:1397] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 06:17:54.989049 6564 ts_tablet_manager.cc:1905] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:54.989135 6536 raft_consensus.cc:348] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.989248 6536 raft_consensus.cc:374] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:54.989289 6536 raft_consensus.cc:729] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Initialized, Role: FOLLOWER
I20260807 06:17:54.989413 6536 consensus_queue.cc:260] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:54.989691 6536 ts_tablet_manager.cc:1428] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:54.991231 5836 catalog_manager.cc:4841] TS 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331): tablet 9eedc54c1a8146e884aae0c90e36232b (table test-table [id=f6dbca51fe2843d59c53c358891d3bd8]) successfully deleted
I20260807 06:17:54.991762 6564 ts_tablet_manager.cc:1918] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:54.991873 6564 log.cc:1196] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/9eedc54c1a8146e884aae0c90e36232b
I20260807 06:17:54.992228 6564 ts_tablet_manager.cc:1939] T 9eedc54c1a8146e884aae0c90e36232b P 6140d6eadd264fff8a604be67d1b02b3: Deleting consensus metadata
W20260807 06:17:54.992795 6115 tablet.cc:2369] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:17:54.993417 5836 catalog_manager.cc:4841] TS 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533): tablet 9eedc54c1a8146e884aae0c90e36232b (table test-table [id=f6dbca51fe2843d59c53c358891d3bd8]) successfully deleted
I20260807 06:17:55.159173 6544 raft_consensus.cc:482] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:55.159333 6544 raft_consensus.cc:504] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.160502 6544 leader_election.cc:288] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.165271 6570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.160800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:45331 (local address 127.26.252.66:59547)
0807 06:17:55.161072 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.161089 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.161266 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.161686 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.161691 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.161709 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:55.161813 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.161818 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.162654 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.162657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.163942 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.163954 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.164808 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.164812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.164907 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.164930 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.165024 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.165109 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":94,"threads_started":1}
I20260807 06:17:55.165261 6529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.160911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:59547 (local address 127.26.252.65:45331)
0807 06:17:55.161073 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.161080 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.161175 (+ 95us) server_negotiation.cc:407] Connection header received
0807 06:17:55.161417 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.161420 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.161472 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.161526 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:55.161931 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.162521 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.164080 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.164683 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.164811 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.164868 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.165055 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.165126 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 06:17:55.165716 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f577517d04748dcbef3650889e26f76" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924" is_pre_election: true
I20260807 06:17:55.165894 6057 raft_consensus.cc:2454] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.165913 6534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.161312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:47169 (local address 127.26.252.67:40533)
0807 06:17:55.161468 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.161473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.161620 (+ 147us) server_negotiation.cc:407] Connection header received
0807 06:17:55.161756 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.161760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.161809 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.161913 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:17:55.162792 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.163354 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.164594 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.165114 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.165233 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.165280 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.165713 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.165799 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:17:55.166231 6571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.161140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40533 (local address 127.26.252.66:47169)
0807 06:17:55.161536 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.161550 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.161645 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.162507 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.162510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.162531 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:17:55.162665 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.162671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.163469 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.163474 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.164455 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.164465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.165480 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.165485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.165579 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.165601 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.166040 (+ 439us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.166108 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":79,"threads_started":1}
I20260807 06:17:55.166340 6151 leader_election.cc:302] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.166649 6544 raft_consensus.cc:2781] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:55.166716 6544 raft_consensus.cc:482] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:55.166762 6544 raft_consensus.cc:3037] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.167028 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f577517d04748dcbef3650889e26f76" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3" is_pre_election: true
I20260807 06:17:55.167219 6433 raft_consensus.cc:2454] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.168128 6544 raft_consensus.cc:504] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.168493 6544 leader_election.cc:288] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Requested vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.168970 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f577517d04748dcbef3650889e26f76" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924"
I20260807 06:17:55.169080 6057 raft_consensus.cc:3037] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.169028 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f577517d04748dcbef3650889e26f76" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3"
I20260807 06:17:55.169196 6433 raft_consensus.cc:3037] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.170071 6057 raft_consensus.cc:2454] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.170305 6433 raft_consensus.cc:2454] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.170383 6151 leader_election.cc:302] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.170804 6544 raft_consensus.cc:2781] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:55.171052 6544 raft_consensus.cc:686] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 1 LEADER]: Becoming Leader. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Running, Role: LEADER
I20260807 06:17:55.171717 6544 consensus_queue.cc:237] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.174178 5851 catalog_manager.cc:5495] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a reported cstate change: term changed from 0 to 1, leader changed from <none> to b445e9b0c6ea46cc9955a0061696229a (127.26.252.66). New cstate: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } health_report { overall_health: UNKNOWN } } }
W20260807 06:17:55.214629 6493 tablet.cc:2369] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:17:55.219707 6307 tablet.cc:2369] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:17:55 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083473, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.126@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:55.253278 6580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.244127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39691 (local address 127.0.0.1:34696)
0807 06:17:55.244468 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.244482 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.244578 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.244853 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.244856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.245233 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:55.245357 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.245363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.246466 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.246469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.247051 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.247060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.247708 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.247711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.247782 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.248441 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:55.248453 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:55.249889 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:55.251832 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:55.251840 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:55.251844 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:55.252070 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:55.252355 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:55.252357 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:55.252359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:55.252438 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:55.252820 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:55.252825 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:55.252920 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.253010 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.253121 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":104,"threads_started":1}
I20260807 06:17:55.253391 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.244239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34696 (local address 127.26.252.126:39691)
0807 06:17:55.244393 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.244398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.244554 (+ 156us) server_negotiation.cc:407] Connection header received
0807 06:17:55.244665 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.244668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.244715 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.244816 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:55.245474 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.246302 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.247182 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.247533 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.247636 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.250029 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:55.250032 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:55.250035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:55.250058 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:55.251723 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:55.252166 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:55.252170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:55.252172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:55.252263 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:55.252522 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:55.252525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:55.252527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:55.252720 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:55.252817 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.253089 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.253212 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:17:55.257532 5851 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:34696:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:17:55.258169 5851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:55.263026 6031 tablet_service.cc:1467] Processing CreateTablet for tablet 7061a3ed37b44211ba83774cca118e1f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c1a2b9bc1df457bb2b9d2e57a1fa8ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:55.263233 6220 tablet_service.cc:1467] Processing CreateTablet for tablet 7061a3ed37b44211ba83774cca118e1f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c1a2b9bc1df457bb2b9d2e57a1fa8ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:55.263509 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7061a3ed37b44211ba83774cca118e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.263624 6220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7061a3ed37b44211ba83774cca118e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.263578 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 7061a3ed37b44211ba83774cca118e1f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8c1a2b9bc1df457bb2b9d2e57a1fa8ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:17:55.263969 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7061a3ed37b44211ba83774cca118e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.266549 6535 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: Bootstrap starting.
I20260807 06:17:55.266620 6537 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: Bootstrap starting.
I20260807 06:17:55.266785 6536 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: Bootstrap starting.
I20260807 06:17:55.267498 6535 tablet_bootstrap.cc:654] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.267598 6537 tablet_bootstrap.cc:654] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.267742 6536 tablet_bootstrap.cc:654] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.268781 6535 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: No bootstrap required, opened a new log
I20260807 06:17:55.268885 6535 ts_tablet_manager.cc:1397] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 06:17:55.268936 6537 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: No bootstrap required, opened a new log
I20260807 06:17:55.269027 6537 ts_tablet_manager.cc:1397] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 06:17:55.269412 6537 raft_consensus.cc:348] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.269413 6535 raft_consensus.cc:348] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.269536 6535 raft_consensus.cc:374] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.269536 6537 raft_consensus.cc:374] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.269582 6535 raft_consensus.cc:729] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0565250a864081a7479817fe8e3924, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.269582 6537 raft_consensus.cc:729] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.269665 6536 tablet_bootstrap.cc:492] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: No bootstrap required, opened a new log
I20260807 06:17:55.269745 6536 ts_tablet_manager.cc:1397] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 06:17:55.269709 6535 consensus_queue.cc:260] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.269724 6537 consensus_queue.cc:260] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.269974 6537 ts_tablet_manager.cc:1428] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 06:17:55.269999 6535 ts_tablet_manager.cc:1428] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:55.270183 6544 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.270171 6536 raft_consensus.cc:348] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.270287 6536 raft_consensus.cc:374] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.270316 6544 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.270231 6543 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.270327 6536 raft_consensus.cc:729] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.270380 6543 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.270478 6536 consensus_queue.cc:260] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.270735 6536 ts_tablet_manager.cc:1428] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:55.270972 6545 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.271106 6545 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.389281 6544 raft_consensus.cc:482] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:55.389430 6544 raft_consensus.cc:504] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.389931 6544 leader_election.cc:288] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.390569 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7061a3ed37b44211ba83774cca118e1f" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924" is_pre_election: true
I20260807 06:17:55.390584 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7061a3ed37b44211ba83774cca118e1f" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3" is_pre_election: true
I20260807 06:17:55.390714 6057 raft_consensus.cc:2454] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.390782 6433 raft_consensus.cc:2454] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.391101 6151 leader_election.cc:302] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.391355 6544 raft_consensus.cc:2781] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:55.391417 6544 raft_consensus.cc:482] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:55.391444 6544 raft_consensus.cc:3037] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.392508 6544 raft_consensus.cc:504] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.392860 6544 leader_election.cc:288] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Requested vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.393242 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7061a3ed37b44211ba83774cca118e1f" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924"
I20260807 06:17:55.393375 6057 raft_consensus.cc:3037] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.393376 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7061a3ed37b44211ba83774cca118e1f" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3"
I20260807 06:17:55.393518 6433 raft_consensus.cc:3037] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.394366 6057 raft_consensus.cc:2454] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.394604 6433 raft_consensus.cc:2454] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.394721 6151 leader_election.cc:302] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.394979 6544 raft_consensus.cc:2781] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:55.395118 6544 raft_consensus.cc:686] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [term 1 LEADER]: Becoming Leader. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Running, Role: LEADER
I20260807 06:17:55.395284 6544 consensus_queue.cc:237] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.396062 6573 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: TxnStatusTablet state changed. Reason: New leader b445e9b0c6ea46cc9955a0061696229a. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.396188 6573 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:55.396499 6587 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:17:55.396679 6587 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:17:55.397209 5852 catalog_manager.cc:5495] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a reported cstate change: term changed from 0 to 1, leader changed from <none> to b445e9b0c6ea46cc9955a0061696229a (127.26.252.66). New cstate: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:55.423372 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.419443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60666 (local address 127.26.252.66:39495)
0807 06:17:55.419723 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.419728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.419743 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:55.419815 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.419817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.419868 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.419988 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.420263 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.420844 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.421728 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.422005 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.422127 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.422469 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.422894 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.423066 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.423140 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.423200 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":88,"threads_started":1}
I20260807 06:17:55.423350 6580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.419242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:39495 (local address 127.0.0.1:60666)
0807 06:17:55.419483 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.419497 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.419627 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.420001 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.420004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.420011 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:55.420147 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.420152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.420964 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.420969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.421592 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.421600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.422128 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.422131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.422230 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.422278 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.423027 (+ 749us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.423044 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.423127 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.423215 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260807 06:17:55.426817 6057 raft_consensus.cc:1261] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.427069 6433 raft_consensus.cc:1261] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.427434 6544 consensus_queue.cc:1035] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.427651 6573 consensus_queue.cc:1035] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.429134 6543 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: TxnStatusTablet state changed. Reason: New leader b445e9b0c6ea46cc9955a0061696229a. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.429263 6543 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.429390 6545 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: TxnStatusTablet state changed. Reason: New leader b445e9b0c6ea46cc9955a0061696229a. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.429504 6545 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.430769 6544 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.430878 6544 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:55.433284 6545 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.433406 6545 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 6140d6eadd264fff8a604be67d1b02b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.435791 6573 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.435905 6573 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P b445e9b0c6ea46cc9955a0061696229a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:17:55.436447 6543 tablet_replica.cc:439] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } } }
I20260807 06:17:55.436565 6543 tablet_replica.cc:442] T 7061a3ed37b44211ba83774cca118e1f P 3e0565250a864081a7479817fe8e3924: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:17:55.443138 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.439926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60668 (local address 127.26.252.66:39495)
0807 06:17:55.440073 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.440077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.440087 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:17:55.440123 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.440125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.440161 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.440245 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.440506 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.441147 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.441997 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.442236 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.442366 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.442672 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.442755 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.442839 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.442935 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.442985 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:17:55.454505 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.450831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:55263 (local address 127.26.252.66:39495)
0807 06:17:55.450966 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.450971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.451217 (+ 246us) server_negotiation.cc:407] Connection header received
0807 06:17:55.451346 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.451348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.451389 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.451450 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.451723 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.452176 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.453438 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.453637 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.453720 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.454044 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.454105 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.454159 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.454288 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.454338 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":48}
I20260807 06:17:55.454540 6598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.450813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:39495 (local address 127.26.252.66:55263)
0807 06:17:55.451128 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.451143 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.451254 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.451484 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.451486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.451494 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:55.451624 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.451630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.452282 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.452285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.453318 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.453329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.453752 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.453756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.453863 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.453913 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.454188 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.454195 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.454268 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.454347 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":128,"threads_started":1}
I20260807 06:17:55.461596 6433 raft_consensus.cc:1261] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.461647 6057 raft_consensus.cc:1261] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.461979 6573 consensus_queue.cc:1035] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.462128 6544 consensus_queue.cc:1035] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.471097 6555 mvcc.cc:205] Tried to move back new op lower bound from 7315797915487424512 to 7315797914306052096. Current Snapshot: MvccSnapshot[applied={T|T < 7315797915487424512}]
I20260807 06:17:55.511087 5852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.511243 5852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.513468 5852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Sending DeleteTablet for 3 replicas of tablet 7f577517d04748dcbef3650889e26f76
I20260807 06:17:55.514037 6220 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f577517d04748dcbef3650889e26f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 06:17:55.514112 6406 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f577517d04748dcbef3650889e26f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:35620
I20260807 06:17:55.514206 6031 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f577517d04748dcbef3650889e26f76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:56006
I20260807 06:17:55.514541 6607 tablet_replica.cc:330] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: stopping tablet replica
I20260807 06:17:55.514686 6607 raft_consensus.cc:2229] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.514606 6604 tablet_replica.cc:330] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: stopping tablet replica
I20260807 06:17:55.514726 6603 tablet_replica.cc:330] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: stopping tablet replica
I20260807 06:17:55.514840 6607 raft_consensus.cc:2258] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.514954 6603 raft_consensus.cc:2229] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:55.515004 6604 raft_consensus.cc:2229] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.515202 6604 raft_consensus.cc:2258] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.515421 6603 raft_consensus.cc:2258] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.516017 6607 ts_tablet_manager.cc:1905] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.516664 6603 ts_tablet_manager.cc:1905] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.516835 6604 ts_tablet_manager.cc:1905] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.519454 6607 ts_tablet_manager.cc:1918] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:55.519553 6607 log.cc:1196] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/7f577517d04748dcbef3650889e26f76
I20260807 06:17:55.519855 6607 ts_tablet_manager.cc:1939] T 7f577517d04748dcbef3650889e26f76 P 3e0565250a864081a7479817fe8e3924: Deleting consensus metadata
I20260807 06:17:55.520637 5836 catalog_manager.cc:4841] TS 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331): tablet 7f577517d04748dcbef3650889e26f76 (table test-table [id=64f530de098547f0ba7378bfc08b7c57]) successfully deleted
I20260807 06:17:55.521054 6603 ts_tablet_manager.cc:1918] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:55.521212 6603 log.cc:1196] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/7f577517d04748dcbef3650889e26f76
I20260807 06:17:55.521693 6603 ts_tablet_manager.cc:1939] T 7f577517d04748dcbef3650889e26f76 P b445e9b0c6ea46cc9955a0061696229a: Deleting consensus metadata
I20260807 06:17:55.521770 6604 ts_tablet_manager.cc:1918] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:55.521865 6604 log.cc:1196] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/7f577517d04748dcbef3650889e26f76
I20260807 06:17:55.522156 6604 ts_tablet_manager.cc:1939] T 7f577517d04748dcbef3650889e26f76 P 6140d6eadd264fff8a604be67d1b02b3: Deleting consensus metadata
I20260807 06:17:55.522745 5837 catalog_manager.cc:4841] TS b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495): tablet 7f577517d04748dcbef3650889e26f76 (table test-table [id=64f530de098547f0ba7378bfc08b7c57]) successfully deleted
I20260807 06:17:55.522939 5836 catalog_manager.cc:4841] TS 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533): tablet 7f577517d04748dcbef3650889e26f76 (table test-table [id=64f530de098547f0ba7378bfc08b7c57]) successfully deleted
Aug 07 06:17:55 dist-test-slave-68xk krb5kdc[5793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:17:55 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:17:55 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:17:55.548602 5914 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:17:55.540598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34704 (local address 127.26.252.126:39691)
0807 06:17:55.540788 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.540794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.540987 (+ 193us) server_negotiation.cc:407] Connection header received
0807 06:17:55.541135 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.541138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.541191 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.541265 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:55.542232 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.542968 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.544204 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.544437 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.544576 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.548466 (+ 3890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34704: BlockingRecv error: recv got EOF from 127.0.0.1:34704 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 06:17:55 dist-test-slave-68xk krb5kdc[5793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM
I20260807 06:17:55.560053 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.550519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34712 (local address 127.26.252.126:39691)
0807 06:17:55.550669 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.550677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.550719 (+ 42us) server_negotiation.cc:407] Connection header received
0807 06:17:55.550887 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.550891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.550944 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.551040 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:55.551687 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.552257 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.553130 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.553364 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.553480 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.556289 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:55.556298 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:55.556301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:55.556327 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:55.557921 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:55.558623 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:55.558630 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:55.558632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:55.558734 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:55.559075 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:55.559079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:55.559083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:55.559309 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:55.559466 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.559740 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.559868 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:17:55.563161 5852 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:55.563702 5852 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:55.569247 6031 tablet_service.cc:1467] Processing CreateTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 (DEFAULT_TABLE table=test-table [id=3c3a0e2f928345abb4b8149981a5d22d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.569291 6220 tablet_service.cc:1467] Processing CreateTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 (DEFAULT_TABLE table=test-table [id=3c3a0e2f928345abb4b8149981a5d22d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.569607 6220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e8414c32456461fb3d1ddb1c6eab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.569612 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e8414c32456461fb3d1ddb1c6eab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.571897 6535 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Bootstrap starting.
I20260807 06:17:55.572292 6537 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Bootstrap starting.
I20260807 06:17:55.573047 6535 tablet_bootstrap.cc:654] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.573277 6537 tablet_bootstrap.cc:654] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.574044 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 (DEFAULT_TABLE table=test-table [id=3c3a0e2f928345abb4b8149981a5d22d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.574395 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e8414c32456461fb3d1ddb1c6eab702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.574519 6537 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: No bootstrap required, opened a new log
I20260807 06:17:55.574656 6537 ts_tablet_manager.cc:1397] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260807 06:17:55.575575 6537 raft_consensus.cc:348] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.575716 6537 raft_consensus.cc:374] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.575750 6537 raft_consensus.cc:729] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.575906 6537 consensus_queue.cc:260] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.576273 6537 ts_tablet_manager.cc:1428] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:55.576941 6536 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Bootstrap starting.
I20260807 06:17:55.577931 6536 tablet_bootstrap.cc:654] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.579370 6535 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: No bootstrap required, opened a new log
I20260807 06:17:55.579483 6535 ts_tablet_manager.cc:1397] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260807 06:17:55.580089 6535 raft_consensus.cc:348] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.580204 6536 tablet_bootstrap.cc:492] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: No bootstrap required, opened a new log
I20260807 06:17:55.580250 6535 raft_consensus.cc:374] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.580292 6536 ts_tablet_manager.cc:1397] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:17:55.580291 6535 raft_consensus.cc:729] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0565250a864081a7479817fe8e3924, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.580447 6535 consensus_queue.cc:260] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.580786 6536 raft_consensus.cc:348] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.580920 6536 raft_consensus.cc:374] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.580971 6536 raft_consensus.cc:729] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.581111 6536 consensus_queue.cc:260] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.581431 6536 ts_tablet_manager.cc:1428] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:55.583202 6535 ts_tablet_manager.cc:1428] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260807 06:17:55.629359 6544 raft_consensus.cc:482] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:55.629522 6544 raft_consensus.cc:504] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.629966 6544 leader_election.cc:288] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.630556 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e8414c32456461fb3d1ddb1c6eab702" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924" is_pre_election: true
I20260807 06:17:55.630571 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e8414c32456461fb3d1ddb1c6eab702" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3" is_pre_election: true
I20260807 06:17:55.630743 6433 raft_consensus.cc:2454] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.630743 6057 raft_consensus.cc:2454] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 0.
I20260807 06:17:55.631134 6151 leader_election.cc:302] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6140d6eadd264fff8a604be67d1b02b3, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.631367 6544 raft_consensus.cc:2781] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:55.631440 6544 raft_consensus.cc:482] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:55.631495 6544 raft_consensus.cc:3037] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.632740 6544 raft_consensus.cc:504] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.633131 6544 leader_election.cc:288] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Requested vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533)
I20260807 06:17:55.633618 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e8414c32456461fb3d1ddb1c6eab702" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6140d6eadd264fff8a604be67d1b02b3"
I20260807 06:17:55.633628 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e8414c32456461fb3d1ddb1c6eab702" candidate_uuid: "b445e9b0c6ea46cc9955a0061696229a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924"
I20260807 06:17:55.633755 6433 raft_consensus.cc:3037] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.633785 6057 raft_consensus.cc:3037] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.634850 6057 raft_consensus.cc:2454] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.635010 6433 raft_consensus.cc:2454] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b445e9b0c6ea46cc9955a0061696229a in term 1.
I20260807 06:17:55.635355 6151 leader_election.cc:302] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6140d6eadd264fff8a604be67d1b02b3, b445e9b0c6ea46cc9955a0061696229a; no voters:
I20260807 06:17:55.635569 6544 raft_consensus.cc:2781] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:55.635672 6544 raft_consensus.cc:686] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 1 LEADER]: Becoming Leader. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Running, Role: LEADER
I20260807 06:17:55.635859 6544 consensus_queue.cc:237] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.637887 5850 catalog_manager.cc:5495] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a reported cstate change: term changed from 0 to 1, leader changed from <none> to b445e9b0c6ea46cc9955a0061696229a (127.26.252.66). New cstate: current_term: 1 leader_uuid: "b445e9b0c6ea46cc9955a0061696229a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } health_report { overall_health: UNKNOWN } } }
I20260807 06:17:55.651187 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.647575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.26.252.66:39495)
0807 06:17:55.647707 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.647710 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.647725 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:55.647820 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.647822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.647866 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.647933 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.648210 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.648860 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.650072 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.650305 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.650396 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.650695 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.650763 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.650819 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.650933 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.650978 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 06:17:55.653228 6057 raft_consensus.cc:1261] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.653261 6433 raft_consensus.cc:1261] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Refusing update from remote peer b445e9b0c6ea46cc9955a0061696229a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.653673 6544 consensus_queue.cc:1035] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.653887 6594 consensus_queue.cc:1035] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.662921 5850 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.663064 5850 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.665076 5850 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Sending DeleteTablet for 3 replicas of tablet 3e8414c32456461fb3d1ddb1c6eab702
I20260807 06:17:55.665668 6031 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:56006
I20260807 06:17:55.665710 6220 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 06:17:55.665889 6607 tablet_replica.cc:330] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: stopping tablet replica
I20260807 06:17:55.665925 6603 tablet_replica.cc:330] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: stopping tablet replica
I20260807 06:17:55.666030 6607 raft_consensus.cc:2229] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.666074 6603 raft_consensus.cc:2229] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:55.666148 6607 raft_consensus.cc:2258] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.666255 6603 raft_consensus.cc:2258] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.666705 6406 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e8414c32456461fb3d1ddb1c6eab702 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:35620
I20260807 06:17:55.666883 6604 tablet_replica.cc:330] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: stopping tablet replica
I20260807 06:17:55.667008 6604 raft_consensus.cc:2229] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.667137 6604 raft_consensus.cc:2258] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.667160 6607 ts_tablet_manager.cc:1905] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.667868 6603 ts_tablet_manager.cc:1905] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.667899 6604 ts_tablet_manager.cc:1905] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.669695 6607 ts_tablet_manager.cc:1918] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:55.669768 6607 log.cc:1196] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/3e8414c32456461fb3d1ddb1c6eab702
I20260807 06:17:55.670020 6607 ts_tablet_manager.cc:1939] T 3e8414c32456461fb3d1ddb1c6eab702 P 3e0565250a864081a7479817fe8e3924: Deleting consensus metadata
I20260807 06:17:55.670228 6604 ts_tablet_manager.cc:1918] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:55.670228 6603 ts_tablet_manager.cc:1918] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:17:55.670298 6603 log.cc:1196] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/3e8414c32456461fb3d1ddb1c6eab702
I20260807 06:17:55.670298 6604 log.cc:1196] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/3e8414c32456461fb3d1ddb1c6eab702
I20260807 06:17:55.670583 6603 ts_tablet_manager.cc:1939] T 3e8414c32456461fb3d1ddb1c6eab702 P b445e9b0c6ea46cc9955a0061696229a: Deleting consensus metadata
I20260807 06:17:55.670780 5836 catalog_manager.cc:4841] TS 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331): tablet 3e8414c32456461fb3d1ddb1c6eab702 (table test-table [id=3c3a0e2f928345abb4b8149981a5d22d]) successfully deleted
I20260807 06:17:55.671126 6604 ts_tablet_manager.cc:1939] T 3e8414c32456461fb3d1ddb1c6eab702 P 6140d6eadd264fff8a604be67d1b02b3: Deleting consensus metadata
I20260807 06:17:55.671311 5837 catalog_manager.cc:4841] TS b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495): tablet 3e8414c32456461fb3d1ddb1c6eab702 (table test-table [id=3c3a0e2f928345abb4b8149981a5d22d]) successfully deleted
I20260807 06:17:55.671896 5836 catalog_manager.cc:4841] TS 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533): tablet 3e8414c32456461fb3d1ddb1c6eab702 (table test-table [id=3c3a0e2f928345abb4b8149981a5d22d]) successfully deleted
I20260807 06:17:55.671867 5850 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:17:55.672286 5850 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:17:55.676951 6031 tablet_service.cc:1467] Processing CreateTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 (DEFAULT_TABLE table=test-table [id=8ade32a2348f4b51bd49b1aefafed023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.677250 6031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b67ca0704e4c2097756442c3cbbfd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.677214 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 (DEFAULT_TABLE table=test-table [id=8ade32a2348f4b51bd49b1aefafed023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.677474 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b67ca0704e4c2097756442c3cbbfd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.679307 6536 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Bootstrap starting.
I20260807 06:17:55.679543 6535 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: Bootstrap starting.
I20260807 06:17:55.680220 6536 tablet_bootstrap.cc:654] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.680702 6535 tablet_bootstrap.cc:654] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.681291 6536 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: No bootstrap required, opened a new log
I20260807 06:17:55.681384 6536 ts_tablet_manager.cc:1397] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:55.681754 6536 raft_consensus.cc:348] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.681838 6536 raft_consensus.cc:374] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.681857 6536 raft_consensus.cc:729] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.681902 6220 tablet_service.cc:1467] Processing CreateTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 (DEFAULT_TABLE table=test-table [id=8ade32a2348f4b51bd49b1aefafed023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:17:55.681981 6536 consensus_queue.cc:260] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.682155 6220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b67ca0704e4c2097756442c3cbbfd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:55.682260 6536 ts_tablet_manager.cc:1428] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:55.684464 6537 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Bootstrap starting.
I20260807 06:17:55.685279 6537 tablet_bootstrap.cc:654] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:55.686551 6537 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: No bootstrap required, opened a new log
I20260807 06:17:55.686654 6537 ts_tablet_manager.cc:1397] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:55.686656 6535 tablet_bootstrap.cc:492] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: No bootstrap required, opened a new log
I20260807 06:17:55.686736 6535 ts_tablet_manager.cc:1397] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260807 06:17:55.687026 6537 raft_consensus.cc:348] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.687147 6537 raft_consensus.cc:374] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.687188 6537 raft_consensus.cc:729] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b445e9b0c6ea46cc9955a0061696229a, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.687150 6535 raft_consensus.cc:348] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.687268 6535 raft_consensus.cc:374] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:55.687309 6535 raft_consensus.cc:729] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e0565250a864081a7479817fe8e3924, State: Initialized, Role: FOLLOWER
I20260807 06:17:55.687362 6537 consensus_queue.cc:260] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.687425 6535 consensus_queue.cc:260] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.687673 6535 ts_tablet_manager.cc:1428] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 06:17:55.688134 6537 ts_tablet_manager.cc:1428] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:17:55.810655 6545 raft_consensus.cc:482] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:17:55.810796 6545 raft_consensus.cc:504] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.811180 6545 leader_election.cc:288] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495)
I20260807 06:17:55.811658 6245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b67ca0704e4c2097756442c3cbbfd9" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e9b0c6ea46cc9955a0061696229a" is_pre_election: true
I20260807 06:17:55.811679 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b67ca0704e4c2097756442c3cbbfd9" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924" is_pre_election: true
I20260807 06:17:55.811851 6057 raft_consensus.cc:2454] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 0.
I20260807 06:17:55.811859 6245 raft_consensus.cc:2454] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 0.
I20260807 06:17:55.812165 6342 leader_election.cc:302] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, 6140d6eadd264fff8a604be67d1b02b3; no voters:
I20260807 06:17:55.812377 6545 raft_consensus.cc:2781] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:17:55.812450 6545 raft_consensus.cc:482] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:17:55.812500 6545 raft_consensus.cc:3037] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.813598 6545 raft_consensus.cc:504] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.813966 6545 leader_election.cc:288] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 election: Requested vote from peers 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331), b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495)
I20260807 06:17:55.814339 6057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b67ca0704e4c2097756442c3cbbfd9" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e0565250a864081a7479817fe8e3924"
I20260807 06:17:55.814440 6245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b67ca0704e4c2097756442c3cbbfd9" candidate_uuid: "6140d6eadd264fff8a604be67d1b02b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b445e9b0c6ea46cc9955a0061696229a"
I20260807 06:17:55.814555 6057 raft_consensus.cc:3037] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.814566 6245 raft_consensus.cc:3037] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:55.815531 6057 raft_consensus.cc:2454] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 1.
I20260807 06:17:55.815636 6245 raft_consensus.cc:2454] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6140d6eadd264fff8a604be67d1b02b3 in term 1.
I20260807 06:17:55.815863 6342 leader_election.cc:302] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e0565250a864081a7479817fe8e3924, 6140d6eadd264fff8a604be67d1b02b3; no voters:
I20260807 06:17:55.816061 6545 raft_consensus.cc:2781] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:55.816259 6545 raft_consensus.cc:686] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 LEADER]: Becoming Leader. State: Replica: 6140d6eadd264fff8a604be67d1b02b3, State: Running, Role: LEADER
I20260807 06:17:55.816430 6545 consensus_queue.cc:237] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } }
I20260807 06:17:55.818172 5852 catalog_manager.cc:5495] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "6140d6eadd264fff8a604be67d1b02b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6140d6eadd264fff8a604be67d1b02b3" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40533 } health_report { overall_health: HEALTHY } } }
I20260807 06:17:55.845000 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.841722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35640 (local address 127.26.252.67:40533)
0807 06:17:55.841987 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.841993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.842008 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:17:55.842052 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.842055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.842106 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.842201 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.842528 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.843062 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.843908 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.844141 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.844255 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.844524 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.844600 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.844681 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.844782 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.844838 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":102,"threads_started":1}
I20260807 06:17:55.854657 6641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.851627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:39495 (local address 127.26.252.67:44257)
0807 06:17:55.851929 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.851942 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.852029 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.852242 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.852244 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.852250 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:55.852328 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.852332 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.852985 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.852987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.853578 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.853586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.853990 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.853992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.854051 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.854091 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.854359 (+ 268us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.854365 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.854458 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.854539 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":105,"threads_started":1}
I20260807 06:17:55.854651 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.851730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:44257 (local address 127.26.252.66:39495)
0807 06:17:55.851859 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.851863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.852007 (+ 144us) server_negotiation.cc:407] Connection header received
0807 06:17:55.852112 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.852114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.852157 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.852227 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.852421 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.852899 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.853680 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.853894 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.853970 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.854217 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.854283 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.854339 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.854490 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.854539 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:17:55.861084 6245 raft_consensus.cc:1261] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Refusing update from remote peer 6140d6eadd264fff8a604be67d1b02b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.861104 6057 raft_consensus.cc:1261] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Refusing update from remote peer 6140d6eadd264fff8a604be67d1b02b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:17:55.861570 6635 consensus_queue.cc:1035] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e0565250a864081a7479817fe8e3924" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.861817 6545 consensus_queue.cc:1035] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b445e9b0c6ea46cc9955a0061696229a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 39495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:17:55.880493 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.877369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:53603 (local address 127.26.252.67:40533)
0807 06:17:55.877480 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:55.877485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:55.877498 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:17:55.877546 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:55.877548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:55.877599 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:55.877687 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:17:55.877924 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.878572 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.879417 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.879651 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.879763 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.880011 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.880106 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.880188 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:55.880292 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 06:17:55.880352 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:17:55.880493 6598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.877190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40533 (local address 127.26.252.66:53603)
0807 06:17:55.877335 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.877357 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:55.877428 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:55.877698 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:55.877701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:55.877709 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:17:55.877808 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.877815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.878682 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.878686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.879289 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:55.879297 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:55.879766 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:55.879770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:55.879857 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:55.879894 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:17:55.880195 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:17:55.880204 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:17:55.880281 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:17:55.880369 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:17:55.901912 5851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.902148 5851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:17:55.904359 5851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7cfd598e0d646c8adea49e6a29df315: Sending DeleteTablet for 3 replicas of tablet 38b67ca0704e4c2097756442c3cbbfd9
I20260807 06:17:55.905015 6220 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60660
I20260807 06:17:55.905082 6406 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:35620
I20260807 06:17:55.905172 6031 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b67ca0704e4c2097756442c3cbbfd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:17:55 UTC) from {username='oryx', principal='oryx/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:56006
I20260807 06:17:55.905362 6604 tablet_replica.cc:330] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: stopping tablet replica
I20260807 06:17:55.905376 6603 tablet_replica.cc:330] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: stopping tablet replica
I20260807 06:17:55.905503 6603 raft_consensus.cc:2229] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.905503 6604 raft_consensus.cc:2229] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:17:55.905619 6603 raft_consensus.cc:2258] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.905704 6604 raft_consensus.cc:2258] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.905817 6607 tablet_replica.cc:330] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924: stopping tablet replica
I20260807 06:17:55.905892 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 5944
I20260807 06:17:55.905929 6607 raft_consensus.cc:2229] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:17:55.906039 6607 raft_consensus.cc:2258] T 38b67ca0704e4c2097756442c3cbbfd9 P 3e0565250a864081a7479817fe8e3924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:17:55.915627 6603 ts_tablet_manager.cc:1905] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.918094 6603 ts_tablet_manager.cc:1918] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:55.918174 6603 log.cc:1196] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/38b67ca0704e4c2097756442c3cbbfd9
I20260807 06:17:55.918514 6603 ts_tablet_manager.cc:1939] T 38b67ca0704e4c2097756442c3cbbfd9 P b445e9b0c6ea46cc9955a0061696229a: Deleting consensus metadata
I20260807 06:17:55.919028 6604 ts_tablet_manager.cc:1905] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:17:55.919333 5837 catalog_manager.cc:4841] TS b445e9b0c6ea46cc9955a0061696229a (127.26.252.66:39495): tablet 38b67ca0704e4c2097756442c3cbbfd9 (table test-table [id=8ade32a2348f4b51bd49b1aefafed023]) successfully deleted
I20260807 06:17:55.922437 6604 ts_tablet_manager.cc:1918] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:17:55.922533 6604 log.cc:1196] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/38b67ca0704e4c2097756442c3cbbfd9
I20260807 06:17:55.922812 6604 ts_tablet_manager.cc:1939] T 38b67ca0704e4c2097756442c3cbbfd9 P 6140d6eadd264fff8a604be67d1b02b3: Deleting consensus metadata
I20260807 06:17:55.923710 5836 catalog_manager.cc:4841] TS 6140d6eadd264fff8a604be67d1b02b3 (127.26.252.67:40533): tablet 38b67ca0704e4c2097756442c3cbbfd9 (table test-table [id=8ade32a2348f4b51bd49b1aefafed023]) successfully deleted
W20260807 06:17:55.925909 5836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:45331 (error 108)
I20260807 06:17:55.926015 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 6129
I20260807 06:17:55.932267 6647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:55.929384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:45331 (local address 127.0.0.1:56016)
0807 06:17:55.932080 (+ 2696us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:55.932161 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:45331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2568,"thread_start_us":68,"threads_started":1}
W20260807 06:17:55.932458 5836 catalog_manager.cc:4584] TS 3e0565250a864081a7479817fe8e3924 (127.26.252.65:45331): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 38b67ca0704e4c2097756442c3cbbfd9: Network error: Client connection negotiation failed: client connection to 127.26.252.65:45331: connect: Connection refused (error 111)
I20260807 06:17:55.939460 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 6321
I20260807 06:17:55.953462 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 5808
2026-08-07T06:17:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3615 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:56 dist-test-slave-68xk krb5kdc[6651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:56 dist-test-slave-68xk krb5kdc[6651](info): set up 2 sockets
Aug 07 06:17:56 dist-test-slave-68xk krb5kdc[6651](info): commencing operation
krb5kdc: starting...
W20260807 06:17:57.198499 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:57 dist-test-slave-68xk krb5kdc[6651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:57.329799 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46393
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:46393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:57.442021 6671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:57.442334 6671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:57.442432 6671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:57.446341 6671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:57.446448 6671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:57.446499 6671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:57.446538 6671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:57.446573 6671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:57.451946 6671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:46393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:46393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:57.453030 6671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:57.454061 6671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:57.462669 6679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:57.462677 6678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:57.462677 6681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:57.463042 6671 server_base.cc:1034] running on GCE node
I20260807 06:17:57.463667 6671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:57.464818 6671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:57.466027 6671 hybrid_clock.cc:648] HybridClock initialized: now 1786083477466012 us; error 39 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T06:17:57Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1516 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:17:57 dist-test-slave-68xk krb5kdc[6687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:17:57 dist-test-slave-68xk krb5kdc[6687](info): set up 2 sockets
Aug 07 06:17:57 dist-test-slave-68xk krb5kdc[6687](info): commencing operation
krb5kdc: starting...
W20260807 06:17:58.685221 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:17:58 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:17:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:17:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:17:58.822202 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42297
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:42297
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:58.957403 6706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:58.957726 6706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:58.957837 6706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:58.961896 6706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:17:58.961990 6706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:58.962029 6706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:58.962086 6706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:17:58.962126 6706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:17:58.967628 6706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:42297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:58.968735 6706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:58.969811 6706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:58.978348 6712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:58.978358 6711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:58.978346 6714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:58.978646 6706 server_base.cc:1034] running on GCE node
I20260807 06:17:58.979151 6706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:58.980208 6706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:58.981423 6706 hybrid_clock.cc:648] HybridClock initialized: now 1786083478981395 us; error 38 us; skew 500 ppm
Aug 07 06:17:58 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083478, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:58.984326 6706 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:17:58.985204 6706 webserver.cc:460] Webserver started at http://127.26.252.126:41979/ using document root <none> and password file <none>
I20260807 06:17:58.985793 6706 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:58.985890 6706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:58.986131 6706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:58.988255 6706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "09d6e35abc684e89a4d49f3f59567883"
format_stamp: "Formatted at 2026-08-07 06:17:58 on dist-test-slave-68xk"
server_key: "4dd0e3d3284ad4e9c7d1fd48114e5042"
server_key_iv: "36bb240cce1d29c936469477b8598b62"
server_key_version: "encryptionkey@0"
I20260807 06:17:58.988830 6706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "09d6e35abc684e89a4d49f3f59567883"
format_stamp: "Formatted at 2026-08-07 06:17:58 on dist-test-slave-68xk"
server_key: "4dd0e3d3284ad4e9c7d1fd48114e5042"
server_key_iv: "36bb240cce1d29c936469477b8598b62"
server_key_version: "encryptionkey@0"
I20260807 06:17:58.992621 6706 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:58.995232 6723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:58.996518 6706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:17:58.996686 6706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "09d6e35abc684e89a4d49f3f59567883"
format_stamp: "Formatted at 2026-08-07 06:17:58 on dist-test-slave-68xk"
server_key: "4dd0e3d3284ad4e9c7d1fd48114e5042"
server_key_iv: "36bb240cce1d29c936469477b8598b62"
server_key_version: "encryptionkey@0"
I20260807 06:17:58.996804 6706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:59.019816 6706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:59.022819 6706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:59.023032 6706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:59.030189 6706 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:42297
I20260807 06:17:59.030200 6792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:42297 every 8 connection(s)
I20260807 06:17:59.031235 6706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:17:59.034075 6793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:17:59.039633 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 6706
I20260807 06:17:59.039777 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:17:59.039776 6793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Bootstrap starting.
I20260807 06:17:59.040117 27633 external_mini_cluster.cc:1428] Setting key 67fac9f90260fec3edfbd7623b647a68
I20260807 06:17:59.042402 6793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Neither blocks nor log segments found. Creating new log.
I20260807 06:17:59.043207 6793 log.cc:824] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Log is configured to *not* fsync() on all Append() calls
I20260807 06:17:59.045063 6793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: No bootstrap required, opened a new log
I20260807 06:17:59.048653 6793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:17:59.048925 6793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:17:59.048988 6793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d6e35abc684e89a4d49f3f59567883, State: Initialized, Role: FOLLOWER
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:59.049490 6793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:17:59.049661 6793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:17:59.049723 6793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:17:59.049872 6793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:17:59.051010 6793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:17:59.051373 6793 leader_election.cc:302] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d6e35abc684e89a4d49f3f59567883; no voters:
I20260807 06:17:59.051733 6793 leader_election.cc:288] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:17:59.051784 6798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:17:59.051985 6798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 LEADER]: Becoming Leader. State: Replica: 09d6e35abc684e89a4d49f3f59567883, State: Running, Role: LEADER
I20260807 06:17:59.052326 6798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:17:59.052973 6793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:17:59.054054 6799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09d6e35abc684e89a4d49f3f59567883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } } }
I20260807 06:17:59.054171 6799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:59.054596 6800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d6e35abc684e89a4d49f3f59567883. Latest consensus state: current_term: 1 leader_uuid: "09d6e35abc684e89a4d49f3f59567883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } } }
I20260807 06:17:59.055546 6800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: This master's current role is: LEADER
I20260807 06:17:59.056095 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.041550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36952 (local address 127.26.252.126:42297)
0807 06:17:59.042019 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:59.042034 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:59.042071 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:17:59.042827 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:59.042847 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:59.043183 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:59.043549 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:59.044390 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.045425 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.046298 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.046857 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.047030 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.049880 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:59.049885 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:59.049898 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:59.049946 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:59.052005 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.052576 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.052581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.052585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.052693 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.052995 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.052999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.053001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.053494 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:59.054442 (+ 948us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:59.054588 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 06:17:59.054893 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":145,"threads_started":1}
W20260807 06:17:59.058171 6821 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:17:59.058274 6821 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:17:59.058362 6809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:17:59.059154 6809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:17:59.064705 6809 catalog_manager.cc:1347] Generated new cluster ID: 97814d1ac313486695cd4aa6dd5f0d88
I20260807 06:17:59.064771 6809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:17:59.100831 6809 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:17:59.102210 6809 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:17:59.117746 6809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Generated new TSK 0
I20260807 06:17:59.118678 6809 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:17:59.157624 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:59.279247 6828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:59.279500 6828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:59.279579 6828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:59.283682 6828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:59.283746 6828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:59.283835 6828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:17:59.289153 6828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:59.290189 6828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:59.291226 6828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:59.300791 6834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.300845 6835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.300834 6839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:59.300974 6828 server_base.cc:1034] running on GCE node
I20260807 06:17:59.301404 6828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:59.302013 6828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:59.303169 6828 hybrid_clock.cc:648] HybridClock initialized: now 1786083479303143 us; error 40 us; skew 500 ppm
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:59.306113 6828 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:17:59.307066 6828 webserver.cc:460] Webserver started at http://127.26.252.65:42663/ using document root <none> and password file <none>
I20260807 06:17:59.307636 6828 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:59.307700 6828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:59.307941 6828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:59.310362 6828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "9db57b2939c24889a57a7fc221889346"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "2796566b0697e6f16015ca5573328a32"
server_key_iv: "5e7c7378b8241456324789670c08ef63"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.311108 6828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "9db57b2939c24889a57a7fc221889346"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "2796566b0697e6f16015ca5573328a32"
server_key_iv: "5e7c7378b8241456324789670c08ef63"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.315414 6828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:17:59.318116 6846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.319506 6828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:17:59.319662 6828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "9db57b2939c24889a57a7fc221889346"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "2796566b0697e6f16015ca5573328a32"
server_key_iv: "5e7c7378b8241456324789670c08ef63"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.319808 6828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:59.335141 6828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:59.338656 6828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:59.338878 6828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:59.339525 6828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:59.340392 6828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:59.340469 6828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.340543 6828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:59.340585 6828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.349968 6828 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:45871
I20260807 06:17:59.349997 6990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:45871 every 8 connection(s)
I20260807 06:17:59.350972 6828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:17:59.355146 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 6828
I20260807 06:17:59.355284 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:17:59.355569 27633 external_mini_cluster.cc:1428] Setting key 0dbc7c412cbdccdb4a3fe07f5918a018
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:17:59.366735 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.352798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:32879 (local address 127.26.252.126:42297)
0807 06:17:59.352982 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:59.352986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:59.353890 (+ 904us) server_negotiation.cc:407] Connection header received
0807 06:17:59.355641 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:59.355645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:59.355706 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:59.355823 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:59.357188 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.357723 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.358982 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.359222 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.359346 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.362366 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:59.362369 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:59.362371 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:59.362396 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:59.364125 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.364784 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.364788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.364789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.364873 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.365325 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.365328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.365329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.365535 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:59.365625 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:59.366333 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 06:17:59.366549 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:17:59.367604 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.353199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:32879)
0807 06:17:59.353694 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:59.353750 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:59.355422 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:59.356008 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:59.356017 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:59.356430 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:59.357027 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.357051 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.357859 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.357862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.358855 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.358865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.359389 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.359393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.359561 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.360205 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:59.360222 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:59.362160 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:59.364258 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.364264 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.364280 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.364656 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.364983 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.364987 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.364989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.365197 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.365665 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:59.365676 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:59.366048 (+ 372us) client_negotiation.cc:769] Sending connection context
0807 06:17:59.366271 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 06:17:59.366660 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":113,"threads_started":1}
I20260807 06:17:59.368954 6991 heartbeater.cc:347] Connected to a master server at 127.26.252.126:42297
I20260807 06:17:59.369202 6991 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:17:59.369863 6991 heartbeater.cc:511] Master 127.26.252.126:42297 requested a full tablet report, sending...
I20260807 06:17:59.371520 6748 ts_manager.cc:194] Registered new tserver with Master: 9db57b2939c24889a57a7fc221889346 (127.26.252.65:45871)
I20260807 06:17:59.372721 6748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:32879
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:17:59.389078 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:59.499892 6997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:59.500157 6997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:59.500240 6997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:59.504277 6997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:59.504354 6997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:59.504474 6997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:17:59.509678 6997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:59.510779 6997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:59.511785 6997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:59.521420 7005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.521430 7003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.521602 7002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:59.521576 6997 server_base.cc:1034] running on GCE node
I20260807 06:17:59.522022 6997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:59.522720 6997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:59.523890 6997 hybrid_clock.cc:648] HybridClock initialized: now 1786083479523858 us; error 50 us; skew 500 ppm
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:59.526690 6997 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:17:59.527550 6997 webserver.cc:460] Webserver started at http://127.26.252.66:37435/ using document root <none> and password file <none>
I20260807 06:17:59.528105 6997 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:59.528196 6997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:59.528432 6997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:59.530493 6997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "0a61f742c1a847ad9a7d698031c9eac9"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "c37c9fad5304cb40a9aded2316b036ce"
server_key_iv: "afb31ea42b31b61f957c46a455414578"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.531071 6997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "0a61f742c1a847ad9a7d698031c9eac9"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "c37c9fad5304cb40a9aded2316b036ce"
server_key_iv: "afb31ea42b31b61f957c46a455414578"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.534706 6997 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:17:59.537034 7013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.538160 6997 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:17:59.538305 6997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "0a61f742c1a847ad9a7d698031c9eac9"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "c37c9fad5304cb40a9aded2316b036ce"
server_key_iv: "afb31ea42b31b61f957c46a455414578"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.538419 6997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:59.554232 6997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:59.557634 6997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:59.557844 6997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:59.558485 6997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:59.559296 6997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:59.559367 6997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.559430 6997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:59.559481 6997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.569147 6997 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:44851
I20260807 06:17:59.569201 7160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:44851 every 8 connection(s)
I20260807 06:17:59.570098 6997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:17:59.575829 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 6997
I20260807 06:17:59.575951 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:17:59.576305 27633 external_mini_cluster.cc:1428] Setting key e956b587792ee16a8387c7093c9a1ce4
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:59.585203 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.572053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:50121 (local address 127.26.252.126:42297)
0807 06:17:59.572206 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:59.572211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:59.573096 (+ 885us) server_negotiation.cc:407] Connection header received
0807 06:17:59.574383 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:59.574385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:59.574486 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:59.574564 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:59.575721 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.576489 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.577841 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.578067 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.578178 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.580922 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:59.580929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:59.580933 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:59.580967 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:59.582664 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.583345 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.583348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.583350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.583431 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.583859 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.583861 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.583862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.584161 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:59.584278 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:59.584800 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 06:17:59.584947 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:17:59.585964 7163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.572492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:50121)
0807 06:17:59.572934 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:59.572977 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:59.574159 (+ 1182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:59.574730 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:59.574736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:59.575081 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:59.575570 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.575584 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.576620 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.576623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.577719 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.577730 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.578232 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.578237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.578489 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.579119 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:59.579136 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:59.580743 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:59.582792 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.582802 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.582822 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.583232 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.583543 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.583548 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.583551 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.583759 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.584284 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:59.584290 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:59.584529 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 06:17:59.584710 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 06:17:59.584969 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":114,"threads_started":1}
I20260807 06:17:59.587286 7161 heartbeater.cc:347] Connected to a master server at 127.26.252.126:42297
I20260807 06:17:59.587548 7161 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:17:59.588110 7161 heartbeater.cc:511] Master 127.26.252.126:42297 requested a full tablet report, sending...
I20260807 06:17:59.589309 6748 ts_manager.cc:194] Registered new tserver with Master: 0a61f742c1a847ad9a7d698031c9eac9 (127.26.252.66:44851)
I20260807 06:17:59.589898 6748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:50121
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:17:59.610162 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:17:59.723210 7166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:17:59.723527 7166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:17:59.723629 7166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:17:59.727677 7166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:17:59.727734 7166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:17:59.727792 7166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:17:59.732995 7166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:17:59.734071 7166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:17:59.735147 7166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:17:59.744964 7175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.744962 7179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:17:59.745024 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:17:59.745390 7166 server_base.cc:1034] running on GCE node
I20260807 06:17:59.745805 7166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:17:59.746523 7166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:17:59.747763 7166 hybrid_clock.cc:648] HybridClock initialized: now 1786083479747741 us; error 37 us; skew 500 ppm
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:17:59.751070 7166 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:17:59.752075 7166 webserver.cc:460] Webserver started at http://127.26.252.67:42881/ using document root <none> and password file <none>
I20260807 06:17:59.752722 7166 fs_manager.cc:359] Metadata directory not provided
I20260807 06:17:59.752831 7166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:17:59.753190 7166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:17:59.755757 7166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "1be2289bc61149cb919b109584fbcd97"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "8c3cb89b069ed31f7b37e5b2ef46631a"
server_key_iv: "b2ea9fc79ccc5822821d10d77304626c"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.756434 7166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "1be2289bc61149cb919b109584fbcd97"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "8c3cb89b069ed31f7b37e5b2ef46631a"
server_key_iv: "b2ea9fc79ccc5822821d10d77304626c"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.760646 7166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:17:59.763342 7189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.764705 7166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:17:59.764858 7166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "1be2289bc61149cb919b109584fbcd97"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "8c3cb89b069ed31f7b37e5b2ef46631a"
server_key_iv: "b2ea9fc79ccc5822821d10d77304626c"
server_key_version: "encryptionkey@0"
I20260807 06:17:59.764982 7166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:17:59.804096 7166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:17:59.807720 7166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:17:59.807935 7166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:17:59.808609 7166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:17:59.809469 7166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:17:59.809541 7166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.809616 7166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:17:59.809671 7166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:17:59.819694 7166 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42311
I20260807 06:17:59.819729 7344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42311 every 8 connection(s)
I20260807 06:17:59.820627 7166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:17:59.827912 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 7166
I20260807 06:17:59.828073 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:17:59.828382 27633 external_mini_cluster.cc:1428] Setting key a61692b12cb4f935511dcf98c56c4930
Aug 07 06:17:59 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083479, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:17:59.835943 6796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.822755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:57919 (local address 127.26.252.126:42297)
0807 06:17:59.822903 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:17:59.822908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:17:59.823652 (+ 744us) server_negotiation.cc:407] Connection header received
0807 06:17:59.825375 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:17:59.825378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:17:59.825443 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:17:59.825533 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:17:59.826808 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.827348 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.828838 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.829102 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.829231 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.831975 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:17:59.831979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:17:59.831983 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:17:59.832016 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:17:59.833645 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.834231 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.834235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.834236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.834319 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:17:59.834733 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:17:59.834737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:17:59.834739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:17:59.834957 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:17:59.835082 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:17:59.835619 (+ 537us) server_negotiation.cc:299] Negotiation successful
0807 06:17:59.835758 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:17:59.836755 7347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:17:59.822993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:57919)
0807 06:17:59.823480 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 06:17:59.823524 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:17:59.825140 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:17:59.825730 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:17:59.825736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:17:59.826105 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:17:59.826658 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.826675 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.827483 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.827491 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.828693 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:17:59.828704 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:17:59.829283 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:17:59.829288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:17:59.829466 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:17:59.830129 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:17:59.830148 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:17:59.831798 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:17:59.833783 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.833789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.833806 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.834090 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.834453 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:17:59.834456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:17:59.834459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:17:59.834614 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:17:59.835079 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:17:59.835087 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:17:59.835354 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 06:17:59.835552 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 06:17:59.835890 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":122,"threads_started":1}
I20260807 06:17:59.837913 7345 heartbeater.cc:347] Connected to a master server at 127.26.252.126:42297
I20260807 06:17:59.838148 7345 heartbeater.cc:464] Registering TS with master...
I20260807 06:17:59.838683 7345 heartbeater.cc:511] Master 127.26.252.126:42297 requested a full tablet report, sending...
I20260807 06:17:59.839685 6748 ts_manager.cc:194] Registered new tserver with Master: 1be2289bc61149cb919b109584fbcd97 (127.26.252.67:42311)
I20260807 06:17:59.840299 6748 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:57919
I20260807 06:17:59.842511 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
Entry for principal oryx/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab.
WARNING: no policy specified for oryx/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
Entry for principal oryx/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab.
WARNING: no policy specified for oryx/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
Entry for principal oryx/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab.
I20260807 06:17:59.934580 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 6828
I20260807 06:17:59.951031 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 6997
I20260807 06:17:59.961050 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 7166
I20260807 06:17:59.969203 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 6706
I20260807 06:17:59.980383 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42297
--webserver_interface=127.26.252.126
--webserver_port=41979
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:42297
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:00.097343 7358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:00.097636 7358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:00.097707 7358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:00.101693 7358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:18:00.101784 7358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:00.101825 7358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:00.101883 7358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:18:00.101922 7358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:18:00.107553 7358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:42297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=41979
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:00.108819 7358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:00.109771 7358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:00.118355 7368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.118357 7366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:00.118451 7358 server_base.cc:1034] running on GCE node
W20260807 06:18:00.118355 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:00.119141 7358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:00.120307 7358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:00.121533 7358 hybrid_clock.cc:648] HybridClock initialized: now 1786083480121496 us; error 48 us; skew 500 ppm
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083480, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:00.124421 7358 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:18:00.125375 7358 webserver.cc:460] Webserver started at http://127.26.252.126:41979/ using document root <none> and password file <none>
I20260807 06:18:00.125949 7358 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:00.126071 7358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:00.129928 7358 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:18:00.132222 7379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.133530 7358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:18:00.133672 7358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "09d6e35abc684e89a4d49f3f59567883"
format_stamp: "Formatted at 2026-08-07 06:17:58 on dist-test-slave-68xk"
server_key: "4dd0e3d3284ad4e9c7d1fd48114e5042"
server_key_iv: "36bb240cce1d29c936469477b8598b62"
server_key_version: "encryptionkey@0"
I20260807 06:18:00.134217 7358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:00.150305 7358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:00.153081 7358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:00.153288 7358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:00.160754 7358 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:42297
I20260807 06:18:00.160779 7446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:42297 every 8 connection(s)
I20260807 06:18:00.161821 7358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:18:00.166121 7447 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:18:00.167775 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Bootstrap starting.
I20260807 06:18:00.168082 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 7358
I20260807 06:18:00.168540 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:45871
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:42297
--webserver_port=42663
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:18:00.185599 7447 log.cc:824] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:00.192306 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:18:00.192701 7447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Bootstrap complete.
I20260807 06:18:00.197151 7447 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:18:00.197558 7447 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d6e35abc684e89a4d49f3f59567883, State: Initialized, Role: FOLLOWER
I20260807 06:18:00.198038 7447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:18:00.198181 7447 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:18:00.198275 7447 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:18:00.198400 7447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:18:00.200379 7447 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:18:00.200718 7447 leader_election.cc:302] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d6e35abc684e89a4d49f3f59567883; no voters:
I20260807 06:18:00.201089 7447 leader_election.cc:288] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:18:00.201190 7453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:18:00.201404 7453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [term 2 LEADER]: Becoming Leader. State: Replica: 09d6e35abc684e89a4d49f3f59567883, State: Running, Role: LEADER
I20260807 06:18:00.201689 7453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } }
I20260807 06:18:00.202337 7447 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:18:00.202667 7453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d6e35abc684e89a4d49f3f59567883. Latest consensus state: current_term: 2 leader_uuid: "09d6e35abc684e89a4d49f3f59567883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } } }
I20260807 06:18:00.202800 7453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:00.203200 7454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09d6e35abc684e89a4d49f3f59567883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d6e35abc684e89a4d49f3f59567883" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42297 } } }
I20260807 06:18:00.203363 7454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:00.204464 7460 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:18:00.207811 7460 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:18:00.208473 7460 catalog_manager.cc:1259] Loaded cluster ID: 97814d1ac313486695cd4aa6dd5f0d88
I20260807 06:18:00.208536 7460 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:18:00.210897 7460 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:18:00.211573 7460 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09d6e35abc684e89a4d49f3f59567883: Loaded TSK: 0
I20260807 06:18:00.212780 7460 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:18:00.285941 7450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:00.286235 7450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:00.286310 7450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:00.290393 7450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:00.290534 7450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:00.290628 7450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:18:00.295933 7450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.65.keytab
--principal=oryx/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:45871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=42663
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:00.297031 7450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:00.298031 7450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:00.307904 7481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.307917 7479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.308099 7478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:00.308740 7450 server_base.cc:1034] running on GCE node
I20260807 06:18:00.309204 7450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:00.309981 7450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:00.311203 7450 hybrid_clock.cc:648] HybridClock initialized: now 1786083480311177 us; error 32 us; skew 500 ppm
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083480, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:00.314833 7450 init.cc:377] Logged in from keytab as oryx/127.26.252.65@KRBTEST.COM (short username oryx)
I20260807 06:18:00.315907 7450 webserver.cc:460] Webserver started at http://127.26.252.65:42663/ using document root <none> and password file <none>
I20260807 06:18:00.316553 7450 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:00.316685 7450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:00.321108 7450 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:18:00.323572 7490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.324962 7450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:18:00.325181 7450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "9db57b2939c24889a57a7fc221889346"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "2796566b0697e6f16015ca5573328a32"
server_key_iv: "5e7c7378b8241456324789670c08ef63"
server_key_version: "encryptionkey@0"
I20260807 06:18:00.325778 7450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:00.349031 7450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:00.352393 7450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:00.352645 7450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:00.353333 7450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:00.354276 7450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:00.354358 7450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.354462 7450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:00.354537 7450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.364615 7450 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:45871
I20260807 06:18:00.364638 7634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:45871 every 8 connection(s)
I20260807 06:18:00.365717 7450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:18:00.367030 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 7450
I20260807 06:18:00.367542 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:44851
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:42297
--webserver_port=37435
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.381047 7637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.368090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:39557)
0807 06:18:00.368569 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.368624 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.369877 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.371411 (+ 1534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.371417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.371783 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.372258 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.372272 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.374620 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.374623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.375538 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.375549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.376826 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.376829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.376978 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.377691 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.377707 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.380277 (+ 2570us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":141,"threads_started":1}
W20260807 06:18:00.381557 7635 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:42297 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.252.126:42297: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
W20260807 06:18:00.381742 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.368060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39557 (local address 127.26.252.126:42297)
0807 06:18:00.368711 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.368734 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.368786 (+ 52us) server_negotiation.cc:407] Connection header received
0807 06:18:00.370379 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.370398 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.370898 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.371322 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.372472 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.374460 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.375682 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.376637 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.376865 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.380629 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:39557: BlockingRecv error: recv got EOF from 127.26.252.65:39557 (error 108)
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":131,"threads_started":1}
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.388331 7637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.382221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:56287)
0807 06:18:00.382517 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.382530 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.382604 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.382848 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.382850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.382999 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.383092 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.383097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.384224 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.384227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.384895 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.384905 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.385569 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.385572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.385645 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.386200 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.386212 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.388232 (+ 2020us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177}
W20260807 06:18:00.388566 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.382346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56287 (local address 127.26.252.126:42297)
0807 06:18:00.382508 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.382513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.382592 (+ 79us) server_negotiation.cc:407] Connection header received
0807 06:18:00.382672 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.382675 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.382729 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.382829 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.383184 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.384072 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.385016 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.385428 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.385548 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.388434 (+ 2886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:56287: BlockingRecv error: recv got EOF from 127.26.252.65:56287 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.394358 7637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.388949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:45623)
0807 06:18:00.389159 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.389175 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.389243 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.389502 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.389503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.389629 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.389707 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.389712 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.390829 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.390832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.391347 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.391354 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.391968 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.391970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.392030 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.392550 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.392561 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.394267 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147}
W20260807 06:18:00.394618 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.389068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:45623 (local address 127.26.252.126:42297)
0807 06:18:00.389197 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.389201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.389217 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:18:00.389329 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.389332 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.389388 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.389477 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.389812 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.390716 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.391467 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.391846 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.391949 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.394491 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:45623: BlockingRecv error: recv got EOF from 127.26.252.65:45623 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 06:18:00.394606 7635 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:18:00.499208 7641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:00.499485 7641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:00.499531 7641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:00.503947 7641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:00.504026 7641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:00.504135 7641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:18:00.509424 7641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.66.keytab
--principal=oryx/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:44851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=37435
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:00.510474 7641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:00.511511 7641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:00.521029 7648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.521037 7649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.521080 7653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:00.521368 7641 server_base.cc:1034] running on GCE node
I20260807 06:18:00.521776 7641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:00.522483 7641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:00.523684 7641 hybrid_clock.cc:648] HybridClock initialized: now 1786083480523643 us; error 60 us; skew 500 ppm
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083480, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:00.526722 7641 init.cc:377] Logged in from keytab as oryx/127.26.252.66@KRBTEST.COM (short username oryx)
I20260807 06:18:00.527796 7641 webserver.cc:460] Webserver started at http://127.26.252.66:37435/ using document root <none> and password file <none>
I20260807 06:18:00.528407 7641 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:00.528527 7641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:00.532886 7641 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 06:18:00.535188 7664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.536667 7641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:18:00.536827 7641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "0a61f742c1a847ad9a7d698031c9eac9"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "c37c9fad5304cb40a9aded2316b036ce"
server_key_iv: "afb31ea42b31b61f957c46a455414578"
server_key_version: "encryptionkey@0"
I20260807 06:18:00.537410 7641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:00.569831 7641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:00.573390 7641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:00.573665 7641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:00.574398 7641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:00.575433 7641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:00.575512 7641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.575598 7641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:00.575659 7641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.586273 7641 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:44851
I20260807 06:18:00.586301 7813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:44851 every 8 connection(s)
I20260807 06:18:00.587458 7641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.597195 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 7641
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.597693 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:42311
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:42297
--webserver_port=42881
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:00.599031 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.589339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:52637 (local address 127.26.252.126:42297)
0807 06:18:00.589489 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.589492 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.590305 (+ 813us) server_negotiation.cc:407] Connection header received
0807 06:18:00.591647 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.591651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.591705 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.591794 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.592997 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.593584 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.594759 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.594997 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.595095 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.598852 (+ 3757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:52637: BlockingRecv error: recv got EOF from 127.26.252.66:52637 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:18:00.599530 7817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.589692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:52637)
0807 06:18:00.590138 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.590180 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.591413 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.591963 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.591969 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.592343 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.592817 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.592831 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.593711 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.593713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.594641 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.594650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.595141 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.595144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.595285 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.595892 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.595908 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.598650 (+ 2742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":116,"threads_started":1}
W20260807 06:18:00.600099 7814 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:42297 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.252.126:42297: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.606004 7817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.600611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:40661)
0807 06:18:00.600777 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.600789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.600856 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.601130 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.601133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.601293 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.601380 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.601385 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.602106 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.602110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.602794 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.602802 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.603283 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.603286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.603379 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.603960 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.603971 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.605864 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 06:18:00.606097 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.600684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:40661 (local address 127.26.252.126:42297)
0807 06:18:00.600818 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.600821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.600835 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:18:00.600961 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.600965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.601017 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.601103 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.601493 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.601998 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.602919 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.603167 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.603310 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.605979 (+ 2669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:40661: BlockingRecv error: recv got EOF from 127.26.252.66:40661 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.611721 7817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.606865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:52175)
0807 06:18:00.606975 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.606990 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.607066 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.607326 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.607329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.607476 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.607540 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.607545 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.608277 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.608280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.608792 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.608799 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.609236 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.609240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.609320 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.609833 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.609844 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.611597 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 06:18:00.611924 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.606939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:52175 (local address 127.26.252.126:42297)
0807 06:18:00.607050 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.607054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.607067 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:18:00.607174 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.607177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.607215 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.607311 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.607678 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.608160 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.608909 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.609128 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.609234 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.611788 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:52175: BlockingRecv error: recv got EOF from 127.26.252.66:52175 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 06:18:00.611940 7814 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:18:00.716095 7820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:00.716413 7820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:00.716493 7820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:00.720621 7820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:00.720682 7820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:00.720773 7820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:18:00.726300 7820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/krb5kdc/oryx_127.26.252.67.keytab
--principal=oryx/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:42311
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=42881
--tserver_master_addrs=127.26.252.126:42297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:00.727442 7820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:00.728473 7820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:00.738214 7828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.738260 7830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:00.738219 7833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:00.739095 7820 server_base.cc:1034] running on GCE node
I20260807 06:18:00.739485 7820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:00.740069 7820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:00.741254 7820 hybrid_clock.cc:648] HybridClock initialized: now 1786083480741229 us; error 35 us; skew 500 ppm
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083480, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:00.744282 7820 init.cc:377] Logged in from keytab as oryx/127.26.252.67@KRBTEST.COM (short username oryx)
I20260807 06:18:00.745249 7820 webserver.cc:460] Webserver started at http://127.26.252.67:42881/ using document root <none> and password file <none>
I20260807 06:18:00.745824 7820 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:00.745924 7820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:00.750313 7820 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:00.752624 7843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.753991 7820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:18:00.754179 7820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "1be2289bc61149cb919b109584fbcd97"
format_stamp: "Formatted at 2026-08-07 06:17:59 on dist-test-slave-68xk"
server_key: "8c3cb89b069ed31f7b37e5b2ef46631a"
server_key_iv: "b2ea9fc79ccc5822821d10d77304626c"
server_key_version: "encryptionkey@0"
I20260807 06:18:00.754815 7820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:00.779266 7820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:00.782286 7820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:00.782547 7820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:00.783208 7820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:00.784091 7820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:00.784165 7820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.784240 7820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:00.784284 7820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:00.793740 7820 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42311
I20260807 06:18:00.793772 7989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42311 every 8 connection(s)
I20260807 06:18:00.794754 7820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:18:00.796003 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 7820
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.806619 7639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.796801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36968 (local address 127.26.252.126:42297)
0807 06:18:00.796951 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.796956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.797489 (+ 533us) server_negotiation.cc:407] Connection header received
0807 06:18:00.797670 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.797674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.797726 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.797816 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.798724 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.799303 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.800431 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.800657 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.800766 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.802355 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:00.802360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:00.802373 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:00.802401 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:00.804400 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:00.804917 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:00.804923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:00.804929 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:00.805075 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:00.805402 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:00.805405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:00.805407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:00.805766 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:00.805987 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:00.806225 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 06:18:00.806495 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 06:18:00.807102 7993 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.797217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:46125 (local address 127.26.252.126:42297)
0807 06:18:00.797514 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.797520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.798084 (+ 564us) server_negotiation.cc:407] Connection header received
0807 06:18:00.799554 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.799557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.799606 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.799698 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.800845 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.801543 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.802833 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.803230 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.803355 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.806990 (+ 3635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:46125: BlockingRecv error: recv got EOF from 127.26.252.67:46125 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
I20260807 06:18:00.807710 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.797398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:46125)
0807 06:18:00.797919 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.797971 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.799358 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.799863 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.799870 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.800205 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.800693 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.800707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.801679 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.801683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.802659 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.802669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.803458 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.803465 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.803714 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.804337 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.804353 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.806862 (+ 2509us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":155,"threads_started":1}
W20260807 06:18:00.808223 7990 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:42297 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.252.126:42297: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.814340 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.808767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:57411)
0807 06:18:00.808898 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.808913 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.808989 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.809270 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.809274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.809435 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.809549 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.809556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.810345 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.810349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.810945 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.810954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.811418 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.811421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.811516 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.812044 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.812057 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.814191 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 06:18:00.814450 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.808876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:57411 (local address 127.26.252.126:42297)
0807 06:18:00.808979 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.808983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.808996 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:18:00.809136 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.809139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.809179 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.809241 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.809737 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.810229 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.811070 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.811302 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.811404 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.814312 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:57411: BlockingRecv error: recv got EOF from 127.26.252.67:57411 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:00 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:00.820143 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:00.814970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:44005)
0807 06:18:00.815239 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:00.815254 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:00.815361 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:00.815614 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:00.815617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:00.815772 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:00.815841 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.815846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.816546 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.816549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.817075 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:00.817083 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.817537 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.817541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:00.817622 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.818109 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:00.818121 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:00.819942 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200}
W20260807 06:18:00.820158 7639 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:00.815078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:44005 (local address 127.26.252.126:42297)
0807 06:18:00.815221 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:00.815226 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:00.815323 (+ 97us) server_negotiation.cc:407] Connection header received
0807 06:18:00.815465 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:00.815468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:00.815512 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:00.815598 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:00.815957 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.816435 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.817196 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:00.817418 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:00.817525 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:00.820053 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:44005: BlockingRecv error: recv got EOF from 127.26.252.67:44005 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 06:18:00.820514 7990 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:01.400628 7995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:01.395314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:35719)
0807 06:18:01.395618 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:01.395636 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:01.395733 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:01.395970 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:01.395972 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:01.396155 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:01.396281 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.396287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.397012 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.397014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.397584 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.397591 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.398008 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.398010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.398079 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.398594 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:01.398606 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:01.400508 (+ 1902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":87,"threads_started":1}
W20260807 06:18:01.400771 7996 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:01.395383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35719 (local address 127.26.252.126:42297)
0807 06:18:01.395672 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:01.395677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:01.395699 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:18:01.395810 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:01.395812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:01.395855 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:01.395932 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:01.396387 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.396923 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.397689 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.397910 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.397991 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.400637 (+ 2646us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:35719: BlockingRecv error: recv got EOF from 127.26.252.65:35719 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:01.618531 7997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:01.612574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:44973)
0807 06:18:01.612917 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:01.612933 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:01.613085 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:01.613359 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:01.613362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:01.613573 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:01.613667 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.613672 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.614497 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.614500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.615082 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.615090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.615569 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.615573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.615661 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.616187 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:01.616199 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:01.618345 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":95,"threads_started":1}
W20260807 06:18:01.618690 7996 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:01.612721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:44973 (local address 127.26.252.126:42297)
0807 06:18:01.612915 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:01.612919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:01.613025 (+ 106us) server_negotiation.cc:407] Connection header received
0807 06:18:01.613187 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:01.613191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:01.613244 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:01.613336 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:01.613810 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.614342 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.615216 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.615449 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.615566 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.618539 (+ 2973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:44973: BlockingRecv error: recv got EOF from 127.26.252.66:44973 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:01 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:01.826611 7998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:01.821229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:44455)
0807 06:18:01.821514 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:01.821528 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:01.821653 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:01.821902 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:01.821904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:01.822087 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:01.822188 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.822193 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.822933 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.822936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.823526 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:01.823535 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.823951 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.823953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:01.824017 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.824578 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:01.824590 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:01.826474 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":108,"threads_started":1}
W20260807 06:18:01.826689 7996 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:01.821313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:44455 (local address 127.26.252.126:42297)
0807 06:18:01.821451 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:01.821455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:01.821605 (+ 150us) server_negotiation.cc:407] Connection header received
0807 06:18:01.821733 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:01.821735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:01.821790 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:01.821858 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:01.822289 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.822833 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.823630 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:01.823852 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:01.823927 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:01.826594 (+ 2667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:44455: BlockingRecv error: recv got EOF from 127.26.252.67:44455 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:02.408180 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:02.401656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:40139)
0807 06:18:02.401983 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:02.401998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:02.402105 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:02.402458 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:02.402461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:02.402691 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:02.402807 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.402813 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.403777 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.403782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.404457 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.404467 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.405252 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.405256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.405360 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.405981 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:02.405993 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:02.408053 (+ 2060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":106,"threads_started":1}
W20260807 06:18:02.408385 8001 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:02.401704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:40139 (local address 127.26.252.126:42297)
0807 06:18:02.402007 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:02.402011 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:02.402058 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:18:02.402190 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:02.402193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:02.402242 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:02.402327 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:02.402956 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.403666 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.404605 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.404975 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.405099 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.408204 (+ 3105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:40139: BlockingRecv error: recv got EOF from 127.26.252.65:40139 (error 108)
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":95,"threads_started":1}
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:02.629774 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:02.619326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:34759)
0807 06:18:02.619684 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:02.619710 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:02.619878 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:02.620205 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:02.620208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:02.620431 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:02.620530 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.620536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.621387 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.621393 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.622009 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.622017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.622558 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.622562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.622667 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.627558 (+ 4891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:02.627572 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:02.629653 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":89,"threads_started":1}
W20260807 06:18:02.630061 8001 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:02.619452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:34759 (local address 127.26.252.126:42297)
0807 06:18:02.619645 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:02.619664 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:02.619809 (+ 145us) server_negotiation.cc:407] Connection header received
0807 06:18:02.619988 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:02.619993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:02.620057 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:02.620158 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:02.620669 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.621263 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.622140 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.622392 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.622541 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.629857 (+ 7316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:34759: BlockingRecv error: recv got EOF from 127.26.252.66:34759 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:02 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:02.833544 8003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:02.827576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:56537)
0807 06:18:02.827900 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:02.827916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:02.828029 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:02.828314 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:02.828317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:02.828537 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:02.828635 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.828640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.829436 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.829440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.830086 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:02.830095 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.830681 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.830685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:02.830776 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.831353 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:02.831365 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:02.833368 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":93,"threads_started":1}
W20260807 06:18:02.833601 8001 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:02.827750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:56537 (local address 127.26.252.126:42297)
0807 06:18:02.827900 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:02.827906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:02.827974 (+ 68us) server_negotiation.cc:407] Connection header received
0807 06:18:02.828137 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:02.828141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:02.828203 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:02.828289 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:02.828763 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.829301 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.830224 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:02.830529 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:02.830646 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:02.833492 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:56537: BlockingRecv error: recv got EOF from 127.26.252.67:56537 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:03.415426 8004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:03.408996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:38789)
0807 06:18:03.409401 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:03.409417 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:03.409516 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:03.409889 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:03.409891 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:03.410182 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:03.410329 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.410337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.411359 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.411363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.411985 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.411993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.412537 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.412540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.412609 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.413209 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:03.413222 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:03.415299 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":129,"threads_started":1}
W20260807 06:18:03.415604 8005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:03.409151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:38789 (local address 127.26.252.126:42297)
0807 06:18:03.409439 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:03.409443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:03.409463 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:18:03.409627 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:03.409632 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:03.409714 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:03.409830 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:03.410512 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.411246 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.412167 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.412418 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.412522 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.415448 (+ 2926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:38789: BlockingRecv error: recv got EOF from 127.26.252.65:38789 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":62,"threads_started":1}
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:03.636360 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:03.630707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:43251)
0807 06:18:03.631044 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:03.631060 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:03.631286 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:03.631544 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:03.631546 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:03.631745 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:03.631848 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.631853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.632591 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.632594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.633196 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.633206 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.633619 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.633622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.633689 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.634291 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:03.634304 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:03.636220 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":98,"threads_started":1}
W20260807 06:18:03.636590 8005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:03.630794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:43251 (local address 127.26.252.126:42297)
0807 06:18:03.630984 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:03.630990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:03.631239 (+ 249us) server_negotiation.cc:407] Connection header received
0807 06:18:03.631380 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:03.631382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:03.631430 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:03.631501 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:03.631951 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.632467 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.633308 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.633520 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.633599 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.636360 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:43251: BlockingRecv error: recv got EOF from 127.26.252.66:43251 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:03 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:03.840179 8008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:03.834475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:46819)
0807 06:18:03.834779 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:03.834793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:03.834895 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:03.835200 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:03.835202 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:03.835402 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:03.835503 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.835508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.836264 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.836267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.836840 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:03.836849 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.837298 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.837303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:03.837387 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.837977 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:03.837989 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:03.839971 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":114,"threads_started":1}
W20260807 06:18:03.840212 8005 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:03.834522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:46819 (local address 127.26.252.126:42297)
0807 06:18:03.834668 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:03.834672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:03.834867 (+ 195us) server_negotiation.cc:407] Connection header received
0807 06:18:03.835027 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:03.835029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:03.835081 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:03.835158 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:03.835614 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.836148 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.836950 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:03.837166 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:03.837243 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:03.840115 (+ 2872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:46819: BlockingRecv error: recv got EOF from 127.26.252.67:46819 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:04.422724 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:04.416338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:34169)
0807 06:18:04.416679 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:04.416695 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:04.416799 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:04.417074 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:04.417076 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:04.417287 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:04.417395 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.417400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.418178 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.418182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.418893 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.418904 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.419404 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.419407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.419476 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.420241 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:04.420255 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:04.422589 (+ 2334us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
W20260807 06:18:04.422909 8010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:04.416457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:34169 (local address 127.26.252.126:42297)
0807 06:18:04.416727 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:04.416731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:04.416749 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:18:04.416904 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:04.416906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:04.416948 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:04.417025 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:04.417515 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.418060 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.419025 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.419265 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.419357 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.422734 (+ 3377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:34169: BlockingRecv error: recv got EOF from 127.26.252.65:34169 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":87,"threads_started":1}
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:04.642724 8011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:04.637102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:46015)
0807 06:18:04.637452 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:04.637470 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:04.637580 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:04.637803 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:04.637805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:04.637991 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:04.638093 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.638098 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.638919 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.638922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.639483 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.639492 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.639926 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.639928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.639992 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.640500 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:04.640512 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:04.642598 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":111,"threads_started":1}
W20260807 06:18:04.642875 8010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:04.637243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:46015 (local address 127.26.252.126:42297)
0807 06:18:04.637428 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:04.637432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:04.637587 (+ 155us) server_negotiation.cc:407] Connection header received
0807 06:18:04.637655 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:04.637657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:04.637706 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:04.637785 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:04.638199 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.638826 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.639598 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.639821 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.639906 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.642738 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:46015: BlockingRecv error: recv got EOF from 127.26.252.66:46015 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:04 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:04.847560 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:04.841231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:53443)
0807 06:18:04.841623 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:04.841641 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:04.841857 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:04.842132 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:04.842134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:04.842363 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:04.842562 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.842571 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.843361 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.843364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.843993 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:04.844004 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.844638 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.844641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:04.844728 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.845362 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:04.845376 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:04.847441 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":119,"threads_started":1}
W20260807 06:18:04.847770 8010 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:04.841239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:53443 (local address 127.26.252.126:42297)
0807 06:18:04.841419 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:04.841425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:04.841833 (+ 408us) server_negotiation.cc:407] Connection header received
0807 06:18:04.841944 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:04.841947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:04.842007 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:04.842079 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:04.842703 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.843253 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.844166 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:04.844507 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:04.844641 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:04.847607 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:53443: BlockingRecv error: recv got EOF from 127.26.252.67:53443 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:05.429265 8013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:05.423543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:39999)
0807 06:18:05.423883 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:05.423904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:05.423999 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:05.424293 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:05.424295 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:05.424486 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:05.424586 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.424591 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.425383 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.425385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.425973 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.425981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.426498 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.426502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.426572 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.427068 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:05.427080 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:05.429051 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
W20260807 06:18:05.429322 8014 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:05.423688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39999 (local address 127.26.252.126:42297)
0807 06:18:05.423938 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:05.423941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:05.423954 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:18:05.424091 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:05.424093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:05.424144 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:05.424241 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:05.424689 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.425270 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.426085 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.426333 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.426488 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.429192 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:39999: BlockingRecv error: recv got EOF from 127.26.252.65:39999 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":64,"threads_started":1}
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:05.649497 8016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:05.643590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:57693)
0807 06:18:05.643893 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:05.643910 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:05.644021 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:05.644301 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:05.644304 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:05.644518 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:05.644620 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.644626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.645539 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.645542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.646185 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.646195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.646701 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.646704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.646770 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.647285 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:05.647298 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:05.649369 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":123,"threads_started":1}
W20260807 06:18:05.649657 8014 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:05.643747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57693 (local address 127.26.252.126:42297)
0807 06:18:05.643887 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:05.643890 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:05.644048 (+ 158us) server_negotiation.cc:407] Connection header received
0807 06:18:05.644125 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:05.644127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:05.644178 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:05.644246 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:05.644750 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.645424 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.646315 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.646589 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.646679 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.649516 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:57693: BlockingRecv error: recv got EOF from 127.26.252.66:57693 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:05 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:05.855033 8017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:05.848506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:58677)
0807 06:18:05.848884 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:05.848899 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:05.849012 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:05.849296 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:05.849298 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:05.849507 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:05.849630 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.849635 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.850556 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.850559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.851240 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:05.851254 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.851772 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.851775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:05.851847 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.852391 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:05.852403 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:05.854848 (+ 2445us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":159,"threads_started":1}
W20260807 06:18:05.855310 8014 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:05.848572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58677 (local address 127.26.252.126:42297)
0807 06:18:05.848744 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:05.848750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:05.848989 (+ 239us) server_negotiation.cc:407] Connection header received
0807 06:18:05.849117 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:05.849119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:05.849168 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:05.849245 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:05.849772 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.850357 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.851389 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:05.851652 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:05.851747 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:05.855019 (+ 3272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:58677: BlockingRecv error: recv got EOF from 127.26.252.67:58677 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:06.436021 8018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:06.430130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:56353)
0807 06:18:06.430518 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:06.430533 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:06.430631 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:06.430971 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:06.430973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:06.431167 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:06.431274 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.431279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.432082 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.432085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.432641 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.432650 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.433155 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.433159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.433239 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.433785 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:06.433798 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:06.435833 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":125,"threads_started":1}
W20260807 06:18:06.436096 8019 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:06.430478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56353 (local address 127.26.252.126:42297)
0807 06:18:06.430741 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:06.430745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:06.430758 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:18:06.430796 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:06.430799 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:06.430842 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:06.430932 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:06.431392 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.431978 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.432762 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.433001 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.433086 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.435960 (+ 2874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:56353: BlockingRecv error: recv got EOF from 127.26.252.65:56353 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":93,"threads_started":1}
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:06.656538 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:06.650272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:33855)
0807 06:18:06.650655 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:06.650672 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:06.650834 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:06.651139 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:06.651142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:06.651388 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:06.651490 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.651497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.652377 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.652383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.653004 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.653012 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.653547 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.653551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.653648 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.654226 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:06.654240 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:06.656345 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":117,"threads_started":1}
W20260807 06:18:06.656620 8019 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:06.650372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:33855 (local address 127.26.252.126:42297)
0807 06:18:06.650592 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:06.650598 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:06.650763 (+ 165us) server_negotiation.cc:407] Connection header received
0807 06:18:06.650947 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:06.650952 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:06.651012 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:06.651111 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:06.651625 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.652247 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.653145 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.653407 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.653528 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.656491 (+ 2963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:33855: BlockingRecv error: recv got EOF from 127.26.252.66:33855 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:06 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:06.861932 8021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:06.855965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:57493)
0807 06:18:06.856340 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:06.856355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:06.856467 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:06.856729 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:06.856732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:06.856932 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:06.857036 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.857041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.857856 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.857859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.858621 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:06.858631 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.859190 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.859194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:06.859295 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.859975 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:06.859988 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:06.861808 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":99,"threads_started":1}
W20260807 06:18:06.862058 8019 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:06.855973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:57493 (local address 127.26.252.126:42297)
0807 06:18:06.856192 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:06.856197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:06.856454 (+ 257us) server_negotiation.cc:407] Connection header received
0807 06:18:06.856538 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:06.856540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:06.856594 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:06.856669 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:06.857141 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.857746 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.858733 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:06.859060 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:06.859155 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:06.861940 (+ 2785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:57493: BlockingRecv error: recv got EOF from 127.26.252.67:57493 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:07.443558 8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:07.436901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:52907)
0807 06:18:07.437412 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:07.437434 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:07.437564 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:07.438073 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:07.438079 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:07.438368 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:07.438533 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.438540 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.439546 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.439549 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.440116 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.440124 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.440690 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.440693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.440761 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.441363 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:07.441375 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:07.443439 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":105,"threads_started":1}
W20260807 06:18:07.443812 8024 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:07.437058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:52907 (local address 127.26.252.126:42297)
0807 06:18:07.437442 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:07.437449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:07.437534 (+ 85us) server_negotiation.cc:407] Connection header received
0807 06:18:07.437707 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:07.437710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:07.437763 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:07.437888 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:07.438690 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.439433 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.440294 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.440573 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.440674 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.443651 (+ 2977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:52907: BlockingRecv error: recv got EOF from 127.26.252.65:52907 (error 108)
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":77,"threads_started":1}
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:07.668900 8025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:07.657378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:39497)
0807 06:18:07.657833 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:07.657847 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:07.657988 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:07.658300 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:07.658302 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:07.658600 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:07.658706 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.658712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.659487 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.659494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.660113 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.660122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.660599 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.660602 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.660695 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.666508 (+ 5813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:07.666522 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:07.668683 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":112,"threads_started":1}
W20260807 06:18:07.669054 8024 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:07.657468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:39497 (local address 127.26.252.126:42297)
0807 06:18:07.657679 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:07.657685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:07.657929 (+ 244us) server_negotiation.cc:407] Connection header received
0807 06:18:07.658106 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:07.658110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:07.658154 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:07.658270 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:07.658827 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.659368 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.660245 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.660475 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.660583 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.668926 (+ 8343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:39497: BlockingRecv error: recv got EOF from 127.26.252.66:39497 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:07 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:07.868897 8026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:07.862823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:44959)
0807 06:18:07.863175 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:07.863189 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:07.863298 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:07.863600 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:07.863603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:07.863810 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:07.863918 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.863924 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.864740 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.864743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.865383 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:07.865392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.865858 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.865861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:07.865923 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.866492 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:07.866503 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:07.868751 (+ 2248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":108,"threads_started":1}
W20260807 06:18:07.869045 8024 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:07.862853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:44959 (local address 127.26.252.126:42297)
0807 06:18:07.863012 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:07.863016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:07.863268 (+ 252us) server_negotiation.cc:407] Connection header received
0807 06:18:07.863387 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:07.863389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:07.863440 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:07.863512 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:07.864072 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.864605 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.865511 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:07.865754 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:07.865838 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:07.868917 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:44959: BlockingRecv error: recv got EOF from 127.26.252.67:44959 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:08.450310 8027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:08.444327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:48735)
0807 06:18:08.444652 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:08.444667 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:08.444808 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:08.445121 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:08.445125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:08.445327 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:08.445432 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.445438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.446331 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.446334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.447022 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.447032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.447554 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.447557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.447638 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.448237 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:08.448250 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:08.450189 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":111,"threads_started":1}
W20260807 06:18:08.450686 8028 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:08.444518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:48735 (local address 127.26.252.126:42297)
0807 06:18:08.444753 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:08.444757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:08.444772 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:18:08.444899 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:08.444901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:08.444948 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:08.445033 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:08.445581 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.446207 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.447192 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.447442 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.447535 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.450519 (+ 2984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:48735: BlockingRecv error: recv got EOF from 127.26.252.65:48735 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":75,"threads_started":1}
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:08.676204 8029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:08.669780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:35113)
0807 06:18:08.670201 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:08.670221 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:08.670367 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:08.670698 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:08.670700 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:08.670923 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:08.671017 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.671022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.671952 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.671957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.672564 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.672574 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.673055 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.673059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.673150 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.673747 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:08.673759 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:08.676026 (+ 2267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":93,"threads_started":1}
W20260807 06:18:08.676273 8028 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:08.669872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:35113 (local address 127.26.252.126:42297)
0807 06:18:08.670153 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:08.670158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:08.670304 (+ 146us) server_negotiation.cc:407] Connection header received
0807 06:18:08.670505 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:08.670514 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:08.670575 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:08.670675 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:08.671144 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.671835 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.672700 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.672930 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.673041 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.676151 (+ 3110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:35113: BlockingRecv error: recv got EOF from 127.26.252.66:35113 (error 108)
Metrics: {"server-negotiator.queue_time_us":176}
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:08 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:08.876596 8030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:08.869894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:58307)
0807 06:18:08.870293 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:08.870307 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:08.870488 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:08.870805 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:08.870808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:08.871044 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:08.871190 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.871198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.872061 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.872067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.872698 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:08.872706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.873215 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.873219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:08.873314 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.874050 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:08.874067 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:08.876473 (+ 2406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":108,"threads_started":1}
W20260807 06:18:08.876865 8028 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:08.870009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58307 (local address 127.26.252.126:42297)
0807 06:18:08.870177 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:08.870182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:08.870399 (+ 217us) server_negotiation.cc:407] Connection header received
0807 06:18:08.870602 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:08.870607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:08.870674 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:08.870776 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:08.871327 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.871933 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.872827 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:08.873082 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:08.873206 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:08.876714 (+ 3508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:58307: BlockingRecv error: recv got EOF from 127.26.252.67:58307 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:09.456957 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:09.451118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:58181)
0807 06:18:09.451410 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:09.451429 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:09.451523 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:09.451810 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:09.451813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:09.452004 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:09.452107 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.452112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.452923 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.452925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.453495 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.453503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.454121 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.454125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.454220 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.454808 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:09.454821 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:09.456770 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":110,"threads_started":1}
W20260807 06:18:09.457023 8032 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:09.451283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:58181 (local address 127.26.252.126:42297)
0807 06:18:09.451544 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:09.451547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:09.451561 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:18:09.451602 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:09.451604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:09.451650 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:09.451747 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:09.452223 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.452824 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.453744 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.453992 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.454105 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.456901 (+ 2796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:58181: BlockingRecv error: recv got EOF from 127.26.252.65:58181 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":98,"threads_started":1}
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:09.683358 8033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:09.677094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:54017)
0807 06:18:09.677417 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:09.677432 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:09.677546 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:09.677892 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:09.677895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:09.678178 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:09.678288 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.678295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.679295 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.679301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.679944 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.679953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.680488 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.680493 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.680588 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.681157 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:09.681170 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:09.683241 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":120,"threads_started":1}
W20260807 06:18:09.683596 8032 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:09.677252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:54017 (local address 127.26.252.126:42297)
0807 06:18:09.677405 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:09.677408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:09.677523 (+ 115us) server_negotiation.cc:407] Connection header received
0807 06:18:09.677654 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:09.677658 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:09.677718 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:09.677820 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:09.678465 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.679162 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.680083 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.680358 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.680484 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.683410 (+ 2926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:54017: BlockingRecv error: recv got EOF from 127.26.252.66:54017 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:09 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:09.883716 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:09.877490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:35139)
0807 06:18:09.877836 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:09.877850 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:09.877959 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:09.878316 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:09.878320 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:09.878595 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:09.878740 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.878749 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.879797 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.879800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.880420 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:09.880438 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.880993 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.880996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:09.881063 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.881663 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:09.881675 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:09.883599 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":143,"threads_started":1}
W20260807 06:18:09.883913 8032 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:09.877682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:35139 (local address 127.26.252.126:42297)
0807 06:18:09.877855 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:09.877860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:09.877917 (+ 57us) server_negotiation.cc:407] Connection header received
0807 06:18:09.878073 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:09.878076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:09.878142 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:09.878277 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:09.878879 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.879657 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.880598 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:09.880867 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:09.880972 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:09.883744 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:35139: BlockingRecv error: recv got EOF from 127.26.252.67:35139 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:10.464583 8035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:10.458049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:56055)
0807 06:18:10.458396 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:10.458439 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:10.458558 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:10.458896 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:10.458899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:10.459163 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:10.459269 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.459275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.460149 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.460154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.460778 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.460786 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.461301 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.461305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.461408 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.461977 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:10.461990 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:10.464465 (+ 2475us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":111,"threads_started":1}
W20260807 06:18:10.464800 8036 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:10.458204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:56055 (local address 127.26.252.126:42297)
0807 06:18:10.458531 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:10.458536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:10.458552 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:18:10.458712 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:10.458715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:10.458764 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:10.458868 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:10.459409 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.460014 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.460912 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.461173 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.461296 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.464637 (+ 3341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:56055: BlockingRecv error: recv got EOF from 127.26.252.65:56055 (error 108)
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":95,"threads_started":1}
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:10.690187 8037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:10.684296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:57261)
0807 06:18:10.684655 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:10.684669 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:10.684820 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:10.685110 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:10.685113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:10.685341 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:10.685437 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.685443 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.686208 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.686212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.686856 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.686866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.687347 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.687350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.687441 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.688017 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:10.688030 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:10.690037 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":94,"threads_started":1}
W20260807 06:18:10.690327 8036 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:10.684436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57261 (local address 127.26.252.126:42297)
0807 06:18:10.684602 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:10.684607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:10.684746 (+ 139us) server_negotiation.cc:407] Connection header received
0807 06:18:10.684923 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:10.684928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:10.684979 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:10.685085 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:10.685561 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.686096 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.686978 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.687224 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.687343 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.690191 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:57261: BlockingRecv error: recv got EOF from 127.26.252.66:57261 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:10 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:10.891175 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:10.884676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:32797)
0807 06:18:10.885069 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:10.885117 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:10.885258 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:10.885558 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:10.885562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:10.885779 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:10.885873 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.885879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.886744 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.886748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.887322 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:10.887330 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.887820 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.887824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:10.887913 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.888481 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:10.888492 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:10.890986 (+ 2494us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":126,"threads_started":1}
W20260807 06:18:10.891216 8036 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:10.884891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:32797 (local address 127.26.252.126:42297)
0807 06:18:10.885069 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:10.885075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:10.885205 (+ 130us) server_negotiation.cc:407] Connection header received
0807 06:18:10.885378 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:10.885381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:10.885439 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:10.885526 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:10.885997 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.886631 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.887445 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:10.887693 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:10.887804 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:10.891115 (+ 3311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:32797: BlockingRecv error: recv got EOF from 127.26.252.67:32797 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:11.471222 8039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:11.465379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:46813)
0807 06:18:11.465674 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:11.465687 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:11.465782 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:11.466029 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:11.466032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:11.466224 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:11.466353 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.466358 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.467248 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.467250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.467812 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.467820 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.468353 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.468356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.468418 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.468961 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:11.468973 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:11.471030 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":113,"threads_started":1}
W20260807 06:18:11.471356 8041 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:11.465465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:46813 (local address 127.26.252.126:42297)
0807 06:18:11.465741 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:11.465745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:11.465758 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:18:11.465855 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:11.465857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:11.465902 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:11.465987 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:11.466509 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.467103 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.467935 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.468231 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.468324 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.471224 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:46813: BlockingRecv error: recv got EOF from 127.26.252.65:46813 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":97,"threads_started":1}
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:11.697209 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:11.691021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:34385)
0807 06:18:11.691304 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:11.691320 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:11.691435 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:11.691739 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:11.691742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:11.691952 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:11.692081 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.692088 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.693027 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.693031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.693676 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.693697 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.694231 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.694234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.694310 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.694906 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:11.694919 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:11.697057 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":117,"threads_started":1}
W20260807 06:18:11.697484 8041 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:11.691156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:34385 (local address 127.26.252.126:42297)
0807 06:18:11.691315 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:11.691319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:11.691385 (+ 66us) server_negotiation.cc:407] Connection header received
0807 06:18:11.691519 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:11.691521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:11.691567 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:11.691658 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:11.692270 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.692889 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.693856 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.694087 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.694180 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.697347 (+ 3167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:34385: BlockingRecv error: recv got EOF from 127.26.252.66:34385 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:11 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:11.897945 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:11.892035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:53561)
0807 06:18:11.892384 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:11.892397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:11.892537 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:11.892850 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:11.892853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:11.893075 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:11.893218 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.893225 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.894014 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.894019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.894660 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:11.894669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.895149 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.895152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:11.895240 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.895857 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:11.895871 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:11.897743 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":132,"threads_started":1}
W20260807 06:18:11.897977 8041 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:11.892116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:53561 (local address 127.26.252.126:42297)
0807 06:18:11.892303 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:11.892308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:11.892482 (+ 174us) server_negotiation.cc:407] Connection header received
0807 06:18:11.892677 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:11.892679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:11.892727 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:11.892823 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:11.893352 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.893895 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.894787 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:11.895018 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:11.895134 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:11.897870 (+ 2736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:53561: BlockingRecv error: recv got EOF from 127.26.252.67:53561 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:12.478566 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:12.472150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:37159)
0807 06:18:12.472480 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:12.472495 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:12.472590 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:12.472909 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:12.472912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:12.473116 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:12.473239 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.473244 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.474106 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.474109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.474710 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.474718 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.475205 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.475209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.475287 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.475919 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:12.475932 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:12.478358 (+ 2426us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":134,"threads_started":1}
W20260807 06:18:12.478713 8046 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:12.472332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:37159 (local address 127.26.252.126:42297)
0807 06:18:12.472591 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:12.472595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:12.472609 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:18:12.472686 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:12.472688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:12.472734 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:12.472815 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:12.473371 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.473987 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.474813 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.475063 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.475153 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.478547 (+ 3394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:37159: BlockingRecv error: recv got EOF from 127.26.252.65:37159 (error 108)
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":100,"threads_started":1}
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:12.709687 8048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:12.698294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:57335)
0807 06:18:12.698647 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:12.698663 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:12.698805 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:12.699228 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:12.699231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:12.699493 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:12.699629 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.699637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.700738 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.700741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.701329 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.701339 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.701850 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.701853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.701979 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.707373 (+ 5394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:12.707387 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:12.709559 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":151,"threads_started":1}
W20260807 06:18:12.709925 8046 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:12.698516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57335 (local address 127.26.252.126:42297)
0807 06:18:12.698670 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:12.698675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:12.698721 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:18:12.698926 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:12.698929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:12.699017 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:12.699128 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:12.699811 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.700615 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.701456 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.701704 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.701799 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.709758 (+ 7959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:57335: BlockingRecv error: recv got EOF from 127.26.252.66:57335 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:12 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:12.905409 8050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:12.899005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:49113)
0807 06:18:12.899337 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:12.899352 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:12.899472 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:12.899788 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:12.899791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:12.899980 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:12.900090 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.900097 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.900930 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.900933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.901532 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:12.901540 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.902138 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.902142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:12.902234 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.902890 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:12.902902 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:12.905225 (+ 2323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":80,"threads_started":1}
W20260807 06:18:12.905469 8046 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:12.899173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:49113 (local address 127.26.252.126:42297)
0807 06:18:12.899349 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:12.899352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:12.899477 (+ 125us) server_negotiation.cc:407] Connection header received
0807 06:18:12.899546 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:12.899548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:12.899644 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:12.899732 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:12.900206 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.900804 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.901700 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:12.901986 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:12.902111 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:12.905357 (+ 3246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:49113: BlockingRecv error: recv got EOF from 127.26.252.67:49113 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:13.485424 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:13.479477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:39417)
0807 06:18:13.479770 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:13.479788 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:13.479925 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:13.480394 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:13.480397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:13.480656 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:13.480814 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.480826 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.481749 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.481752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.482344 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.482353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.482831 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.482834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.482897 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.483401 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:13.483413 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:13.485305 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":124,"threads_started":1}
W20260807 06:18:13.485591 8052 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:13.479558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39417 (local address 127.26.252.126:42297)
0807 06:18:13.479874 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:13.479881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:13.479903 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:18:13.480039 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:13.480062 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:13.480124 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:13.480244 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:13.480940 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.481636 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.482489 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.482724 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.482806 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.485447 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:39417: BlockingRecv error: recv got EOF from 127.26.252.65:39417 (error 108)
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":105,"threads_started":1}
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:13.716521 8053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:13.710732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:35489)
0807 06:18:13.711010 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:13.711024 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:13.711130 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:13.711409 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:13.711412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:13.711602 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:13.711705 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.711710 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.712442 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.712445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.713009 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.713017 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.713520 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.713523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.713589 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.714165 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:13.714177 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:13.716330 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":72,"threads_started":1}
W20260807 06:18:13.716566 8052 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:13.710899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:35489 (local address 127.26.252.126:42297)
0807 06:18:13.711071 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:13.711075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:13.711089 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:18:13.711221 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:13.711223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:13.711267 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:13.711337 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:13.711816 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.712335 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.713136 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.713405 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.713491 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.716457 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:35489: BlockingRecv error: recv got EOF from 127.26.252.66:35489 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:13 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:13.912053 8054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:13.906331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:34365)
0807 06:18:13.906673 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:13.906686 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:13.906794 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:13.907052 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:13.907054 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:13.907268 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:13.907372 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.907377 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.908106 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.908108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.908727 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:13.908737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.909188 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.909191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:13.909281 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.909784 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:13.909796 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:13.911862 (+ 2066us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":138,"threads_started":1}
W20260807 06:18:13.912101 8052 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:13.906497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:34365 (local address 127.26.252.126:42297)
0807 06:18:13.906663 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:13.906673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:13.906760 (+ 87us) server_negotiation.cc:407] Connection header received
0807 06:18:13.906879 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:13.906881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:13.906930 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:13.907008 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:13.907477 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.908008 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.908854 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:13.909080 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:13.909164 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:13.911989 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:34365: BlockingRecv error: recv got EOF from 127.26.252.67:34365 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:14.491855 8055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:14.486231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:38885)
0807 06:18:14.486579 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:14.486594 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:14.486756 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:14.487033 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:14.487036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:14.487226 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:14.487324 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.487328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.488095 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.488098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.488657 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.488665 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.489110 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.489112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.489177 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.489672 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:14.489684 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:14.491680 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":103,"threads_started":1}
W20260807 06:18:14.491940 8056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:14.486330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:38885 (local address 127.26.252.126:42297)
0807 06:18:14.486721 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:14.486727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:14.486744 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:18:14.486869 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:14.486871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:14.486916 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:14.486993 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:14.487439 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.487993 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.488773 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.489000 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.489083 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.491811 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:38885: BlockingRecv error: recv got EOF from 127.26.252.65:38885 (error 108)
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":65,"threads_started":1}
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:14.723591 8057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:14.717551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:55031)
0807 06:18:14.717868 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:14.717882 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:14.717996 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:14.718222 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:14.718224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:14.718467 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:14.718573 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.718578 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.719407 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.719410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.720254 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.720267 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.720813 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.720816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.720888 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.721407 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:14.721421 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:14.723402 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":116,"threads_started":1}
W20260807 06:18:14.723626 8056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:14.717613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:55031 (local address 127.26.252.126:42297)
0807 06:18:14.717789 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:14.717793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:14.717963 (+ 170us) server_negotiation.cc:407] Connection header received
0807 06:18:14.718083 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:14.718085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:14.718132 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:14.718210 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:14.718682 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.719275 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.720391 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.720697 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.720787 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.723520 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:55031: BlockingRecv error: recv got EOF from 127.26.252.66:55031 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:14 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.67@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:14.919013 8058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:14.912975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.67:53559)
0807 06:18:14.913316 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:14.913330 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:14.913433 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:14.913723 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:14.913726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:14.913931 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:14.914034 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.914039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.914896 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.914899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.915494 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:14.915502 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.916025 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.916029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:14.916104 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.916694 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:14.916707 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:14.918868 (+ 2161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":96,"threads_started":1}
W20260807 06:18:14.919189 8056 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:14.913080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:53559 (local address 127.26.252.126:42297)
0807 06:18:14.913239 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:14.913244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:14.913387 (+ 143us) server_negotiation.cc:407] Connection header received
0807 06:18:14.913520 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:14.913522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:14.913570 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:14.913637 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:14.914157 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.914775 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.915655 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:14.915885 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:14.915978 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:14.919036 (+ 3058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.67:53559: BlockingRecv error: recv got EOF from 127.26.252.67:53559 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 06:18:15 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:15 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.65@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:15.498883 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:15.492844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.65:45047)
0807 06:18:15.493145 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:15.493160 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:15.493246 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:15.493546 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:15.493549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:15.493747 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:15.493844 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:15.493849 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.494682 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.494685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:15.495249 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:15.495257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.495847 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.495851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:15.495943 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:15.496592 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:15.496605 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:15.498758 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":115,"threads_started":1}
W20260807 06:18:15.499012 8062 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:15.492985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:45047 (local address 127.26.252.126:42297)
0807 06:18:15.493240 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:15.493244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:15.493258 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:18:15.493332 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:15.493334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:15.493375 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:15.493449 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:15.493977 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.494556 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.495365 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.495711 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.495836 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:15.498860 (+ 3024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.65:45047: BlockingRecv error: recv got EOF from 127.26.252.65:45047 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":93,"threads_started":1}
Aug 07 06:18:15 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:18:15 dist-test-slave-68xk krb5kdc[6687](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.252.66@KRBTEST.COM for oryx/127.26.252.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:18:15.730715 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:15.724591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:42297 (local address 127.26.252.66:49865)
0807 06:18:15.724887 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:15.724901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:15.724996 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:15.725304 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:15.725306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:15.725498 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:15.725596 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:15.725601 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.726463 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.726466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:15.727084 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:15.727095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.727605 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.727609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:15.727691 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:15.728257 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:15.728277 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:15.730554 (+ 2277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.252.126:42297: Server oryx/127.26.252.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":107,"threads_started":1}
W20260807 06:18:15.730886 8062 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:15.724770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:49865 (local address 127.26.252.126:42297)
0807 06:18:15.724931 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:15.724934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:15.724953 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:18:15.725105 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:15.725108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:15.725159 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:15.725261 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:15.725748 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.726306 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.727212 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:15.727450 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:15.727542 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:15.730754 (+ 3212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.252.66:49865: BlockingRecv error: recv got EOF from 127.26.252.66:49865 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:18:15.798264 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 7450
I20260807 06:18:15.816395 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 7641
I20260807 06:18:15.826205 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 7820
I20260807 06:18:15.836439 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 7358
2026-08-07T06:18:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18362 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T06:18:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:18:15Z Disabled control of system clock
I20260807 06:18:15.873217 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44699
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:18:15.990532 8067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:15.990819 8067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:15.990856 8067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:15.994939 8067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:18:15.995007 8067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:15.995023 8067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:15.995039 8067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:18:15.995054 8067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:18:16.000047 8067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:16.001179 8067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:16.002681 8067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:16.011507 8078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.011497 8073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.011497 8074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.011778 8067 server_base.cc:1034] running on GCE node
I20260807 06:18:16.012387 8067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:16.013561 8067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:16.014755 8067 hybrid_clock.cc:648] HybridClock initialized: now 1786083496014727 us; error 45 us; skew 500 ppm
I20260807 06:18:16.016711 8067 webserver.cc:460] Webserver started at http://127.26.252.126:40391/ using document root <none> and password file <none>
I20260807 06:18:16.017318 8067 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:16.017385 8067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:16.017688 8067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:16.019852 8067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "b149bf056fb442b9b7a6961c723d8f49"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "a01be45731ef05eeeb8e11a4f26e122d"
server_key_iv: "64cc9454eda4fc362cf36912d906d347"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.020426 8067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "b149bf056fb442b9b7a6961c723d8f49"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "a01be45731ef05eeeb8e11a4f26e122d"
server_key_iv: "64cc9454eda4fc362cf36912d906d347"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.024389 8067 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 06:18:16.027056 8084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.028395 8067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:16.028546 8067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "b149bf056fb442b9b7a6961c723d8f49"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "a01be45731ef05eeeb8e11a4f26e122d"
server_key_iv: "64cc9454eda4fc362cf36912d906d347"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.028671 8067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:16.041476 8067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:16.042174 8067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:16.042394 8067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:16.049515 8067 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44699
I20260807 06:18:16.049585 8151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44699 every 8 connection(s)
I20260807 06:18:16.050653 8067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:18:16.053928 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:16.059501 8152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49: Bootstrap starting.
I20260807 06:18:16.060062 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8067
I20260807 06:18:16.060182 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:18:16.060485 27633 external_mini_cluster.cc:1428] Setting key 8a31ce7d1bc52fc4c1a43b8ed8443807
I20260807 06:18:16.062463 8152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:16.063273 8152 log.cc:824] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:16.065218 8152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49: No bootstrap required, opened a new log
I20260807 06:18:16.068898 8152 raft_consensus.cc:348] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } }
I20260807 06:18:16.069164 8152 raft_consensus.cc:374] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:16.069250 8152 raft_consensus.cc:729] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b149bf056fb442b9b7a6961c723d8f49, State: Initialized, Role: FOLLOWER
I20260807 06:18:16.069772 8152 consensus_queue.cc:260] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } }
I20260807 06:18:16.069901 8152 raft_consensus.cc:388] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:18:16.069986 8152 raft_consensus.cc:482] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:18:16.070084 8152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:16.070297 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.061871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60108 (local address 127.26.252.126:44699)
0807 06:18:16.062578 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.062617 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.062664 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:18:16.063313 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.063331 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.063807 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.064142 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.064582 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.065634 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.066642 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.067125 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.067303 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.068284 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:16.068291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:16.068311 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:16.068707 (+ 396us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:16.068787 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:16.068809 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:16.068924 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:16.069084 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:18:16.069377 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":147,"threads_started":1}
I20260807 06:18:16.071081 8152 raft_consensus.cc:504] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } }
I20260807 06:18:16.071427 8152 leader_election.cc:302] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b149bf056fb442b9b7a6961c723d8f49; no voters:
I20260807 06:18:16.071769 8152 leader_election.cc:288] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:18:16.071844 8158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:18:16.072093 8158 raft_consensus.cc:686] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [term 1 LEADER]: Becoming Leader. State: Replica: b149bf056fb442b9b7a6961c723d8f49, State: Running, Role: LEADER
I20260807 06:18:16.072451 8158 consensus_queue.cc:237] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } }
I20260807 06:18:16.073053 8152 sys_catalog.cc:564] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:18:16.073705 8158 sys_catalog.cc:455] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b149bf056fb442b9b7a6961c723d8f49. Latest consensus state: current_term: 1 leader_uuid: "b149bf056fb442b9b7a6961c723d8f49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } } }
I20260807 06:18:16.073925 8158 sys_catalog.cc:458] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:16.074112 8159 sys_catalog.cc:455] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b149bf056fb442b9b7a6961c723d8f49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b149bf056fb442b9b7a6961c723d8f49" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44699 } } }
I20260807 06:18:16.074321 8159 sys_catalog.cc:458] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:16.074379 8168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:18:16.077256 8168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:18:16.083033 8168 catalog_manager.cc:1347] Generated new cluster ID: c4d5db6333be45c8a6322c90dd1cb6cc
I20260807 06:18:16.083099 8168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:18:16.087690 8168 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:18:16.088528 8168 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:18:16.093698 8168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b149bf056fb442b9b7a6961c723d8f49: Generated new TSK 0
I20260807 06:18:16.094383 8168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:18:16.101819 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--builtin_ntp_servers=127.26.252.84:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 06:18:16.220994 8181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:16.221261 8181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:16.221298 8181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:16.225536 8181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:16.225597 8181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:16.225682 8181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:18:16.230468 8181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:16.231585 8181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:16.233180 8181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:16.242769 8190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.242791 8187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.242835 8186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.243103 8181 server_base.cc:1034] running on GCE node
I20260807 06:18:16.243498 8181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:16.244155 8181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:16.245345 8181 hybrid_clock.cc:648] HybridClock initialized: now 1786083496245325 us; error 32 us; skew 500 ppm
I20260807 06:18:16.247282 8181 webserver.cc:460] Webserver started at http://127.26.252.65:42531/ using document root <none> and password file <none>
I20260807 06:18:16.247838 8181 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:16.247898 8181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:16.248063 8181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:16.250083 8181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "1006a537040a4740afae96302f0b51b3"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "c99aba9877e8be00637ae2184e964a9e"
server_key_iv: "5d64bcc84c39df1b09c3b3bfa3a24893"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.250687 8181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "1006a537040a4740afae96302f0b51b3"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "c99aba9877e8be00637ae2184e964a9e"
server_key_iv: "5d64bcc84c39df1b09c3b3bfa3a24893"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.254357 8181 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:18:16.256966 8198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.258306 8181 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 06:18:16.258479 8181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "1006a537040a4740afae96302f0b51b3"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "c99aba9877e8be00637ae2184e964a9e"
server_key_iv: "5d64bcc84c39df1b09c3b3bfa3a24893"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.258606 8181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:16.281525 8181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:16.282236 8181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:16.282477 8181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:16.283104 8181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:16.284078 8181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:16.284161 8181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.284226 8181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:16.284272 8181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.293601 8181 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:36527
I20260807 06:18:16.293633 8337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:36527 every 8 connection(s)
I20260807 06:18:16.294538 8181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:18:16.300866 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8181
I20260807 06:18:16.301023 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:18:16.301385 27633 external_mini_cluster.cc:1428] Setting key e3b090b25dc2942a4950c83264bc60b4
I20260807 06:18:16.303669 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--builtin_ntp_servers=127.26.252.84:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 06:18:16.305320 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.296505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:52869 (local address 127.26.252.126:44699)
0807 06:18:16.296686 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.296692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.297881 (+ 1189us) server_negotiation.cc:407] Connection header received
0807 06:18:16.299370 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.299373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.299428 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.299515 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.300522 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.301272 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.302906 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.303261 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.303404 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.304741 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:16.304745 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:16.304748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:16.304767 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:16.304788 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:16.304797 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:16.304889 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:16.305089 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 06:18:16.305158 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:18:16.306327 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.296986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44699 (local address 127.26.252.65:52869)
0807 06:18:16.297713 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:16.297755 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:16.299139 (+ 1384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:16.299724 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:16.299731 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:16.299821 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:16.300345 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.300362 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.301422 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.301428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.302648 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.302751 (+ 103us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.303449 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.303454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.303639 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.304425 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:16.304427 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:16.304470 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:16.304538 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:16.304892 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:16.304906 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:16.304916 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 06:18:16.305089 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 06:18:16.305409 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":146,"threads_started":1}
I20260807 06:18:16.307772 8338 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44699
I20260807 06:18:16.308022 8338 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:16.308591 8338 heartbeater.cc:511] Master 127.26.252.126:44699 requested a full tablet report, sending...
I20260807 06:18:16.310273 8105 ts_manager.cc:194] Registered new tserver with Master: 1006a537040a4740afae96302f0b51b3 (127.26.252.65:36527)
I20260807 06:18:16.311574 8105 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.65:52869
W20260807 06:18:16.420883 8342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:16.421137 8342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:16.421175 8342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:16.425343 8342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:16.425400 8342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:16.425483 8342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:18:16.430156 8342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:16.431273 8342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:16.432778 8342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:16.442718 8351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.442930 8342 server_base.cc:1034] running on GCE node
W20260807 06:18:16.442787 8349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.442767 8348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.443352 8342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:16.444058 8342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:16.445309 8342 hybrid_clock.cc:648] HybridClock initialized: now 1786083496445288 us; error 31 us; skew 500 ppm
I20260807 06:18:16.447582 8342 webserver.cc:460] Webserver started at http://127.26.252.66:41043/ using document root <none> and password file <none>
I20260807 06:18:16.448235 8342 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:16.448342 8342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:16.448609 8342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:16.451022 8342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "89a96f79fa024aecb1a2cff9f63601e8"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "6032a4ae6effaf64fb61d53d768266ff"
server_key_iv: "87a283d7fe2e53dfaf2f6543e8b56df5"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.451660 8342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "89a96f79fa024aecb1a2cff9f63601e8"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "6032a4ae6effaf64fb61d53d768266ff"
server_key_iv: "87a283d7fe2e53dfaf2f6543e8b56df5"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.455684 8342 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:18:16.458338 8363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.459734 8342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:18:16.459889 8342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "89a96f79fa024aecb1a2cff9f63601e8"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "6032a4ae6effaf64fb61d53d768266ff"
server_key_iv: "87a283d7fe2e53dfaf2f6543e8b56df5"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.460011 8342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:16.472040 8342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:16.472739 8342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:16.472944 8342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:16.473706 8342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:16.474884 8342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:16.474965 8342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.475032 8342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:16.475083 8342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.484131 8342 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:42285
I20260807 06:18:16.484220 8517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:42285 every 8 connection(s)
I20260807 06:18:16.485087 8342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:18:16.491726 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8342
I20260807 06:18:16.491859 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:18:16.492187 27633 external_mini_cluster.cc:1428] Setting key 4a188e8444d5854ed14bff175ca84cd5
I20260807 06:18:16.494524 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--builtin_ntp_servers=127.26.252.84:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 06:18:16.495332 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.487268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:55487 (local address 127.26.252.126:44699)
0807 06:18:16.487429 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.487434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.488595 (+ 1161us) server_negotiation.cc:407] Connection header received
0807 06:18:16.489972 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.489975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.490025 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.490102 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.491028 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.491606 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.493107 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.493402 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.493518 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.494854 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:16.494857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:16.494859 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:16.494871 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:16.494891 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:16.494899 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:16.494962 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:16.495155 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:18:16.495218 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:18:16.496780 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.487728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44699 (local address 127.26.252.66:55487)
0807 06:18:16.488446 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:16.488487 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:16.489768 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:16.490244 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:16.490250 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:16.490333 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:16.490897 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.490911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.491759 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.491763 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.492989 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.493000 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.493585 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.493589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.493808 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.494524 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:16.494526 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:16.494583 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:16.494676 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:16.494992 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:16.495004 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:16.495013 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:18:16.495149 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 06:18:16.495474 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":126,"threads_started":1}
I20260807 06:18:16.498147 8518 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44699
I20260807 06:18:16.498467 8518 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:16.499032 8518 heartbeater.cc:511] Master 127.26.252.126:44699 requested a full tablet report, sending...
I20260807 06:18:16.500160 8105 ts_manager.cc:194] Registered new tserver with Master: 89a96f79fa024aecb1a2cff9f63601e8 (127.26.252.66:42285)
I20260807 06:18:16.500797 8105 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.66:55487
W20260807 06:18:16.611166 8523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:16.611451 8523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:16.611524 8523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:16.615577 8523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:16.615660 8523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:16.615746 8523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:18:16.620654 8523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:16.621807 8523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:16.623252 8523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:16.633569 8529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.633558 8528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.633555 8532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.634017 8523 server_base.cc:1034] running on GCE node
I20260807 06:18:16.634517 8523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:16.635186 8523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:16.636361 8523 hybrid_clock.cc:648] HybridClock initialized: now 1786083496636339 us; error 33 us; skew 500 ppm
I20260807 06:18:16.638351 8523 webserver.cc:460] Webserver started at http://127.26.252.67:34643/ using document root <none> and password file <none>
I20260807 06:18:16.639195 8523 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:16.639330 8523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:16.639591 8523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:16.641793 8523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "5330cb653737455cb126bffebda057d4"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "eeac59abbb668f59cdd3827bdb140689"
server_key_iv: "bbb0a4ce46e62ca0699ac9c33943bf83"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.642381 8523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "5330cb653737455cb126bffebda057d4"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "eeac59abbb668f59cdd3827bdb140689"
server_key_iv: "bbb0a4ce46e62ca0699ac9c33943bf83"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.646993 8523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:18:16.649793 8542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.651229 8523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:16.651377 8523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "5330cb653737455cb126bffebda057d4"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "eeac59abbb668f59cdd3827bdb140689"
server_key_iv: "bbb0a4ce46e62ca0699ac9c33943bf83"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.651495 8523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:16.665697 8523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:16.666515 8523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:16.666724 8523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:16.667357 8523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:16.668385 8523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:16.668462 8523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.668538 8523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:16.668581 8523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.678368 8523 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:40641
I20260807 06:18:16.678550 8695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:40641 every 8 connection(s)
I20260807 06:18:16.679476 8523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:18:16.682874 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8523
I20260807 06:18:16.682984 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:18:16.683264 27633 external_mini_cluster.cc:1428] Setting key c4867381914ca573e7f9a851f13e2ca3
I20260807 06:18:16.689411 8156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.681366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:57939 (local address 127.26.252.126:44699)
0807 06:18:16.681549 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.681554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.682784 (+ 1230us) server_negotiation.cc:407] Connection header received
0807 06:18:16.684577 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.684581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.684644 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.684745 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.685869 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.686448 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.687587 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.687817 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.687894 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.688999 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:16.689002 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:16.689004 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:16.689015 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:16.689031 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:16.689039 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:16.689094 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:16.689247 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 06:18:16.689298 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 06:18:16.690268 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.681814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44699 (local address 127.26.252.67:57939)
0807 06:18:16.682603 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:16.682660 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:16.684329 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:16.684961 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:16.684969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:16.685064 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:16.685726 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.685742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.686577 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.686580 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.687477 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:16.687487 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:16.687955 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:16.687958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:16.688094 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:16.688758 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:16.688760 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:16.688800 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:16.688862 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:16.689112 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:16.689119 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:16.689123 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:18:16.689216 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:18:16.689456 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":116,"threads_started":1}
I20260807 06:18:16.691434 8696 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44699
I20260807 06:18:16.691686 8696 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:16.692229 8696 heartbeater.cc:511] Master 127.26.252.126:44699 requested a full tablet report, sending...
I20260807 06:18:16.693324 8105 ts_manager.cc:194] Registered new tserver with Master: 5330cb653737455cb126bffebda057d4 (127.26.252.67:40641)
I20260807 06:18:16.693910 8105 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.67:57939
I20260807 06:18:16.697467 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:18:16.700598 8156 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:16.699697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.26.252.126:44699)
0807 06:18:16.699868 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.699872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.699956 (+ 84us) server_negotiation.cc:407] Connection header received
0807 06:18:16.700058 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.700060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.700097 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.700167 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.700433 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60122: BlockingRecv error: recv got EOF from 127.0.0.1:60122 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 06:18:16.700738 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8181
I20260807 06:18:16.717065 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8342
I20260807 06:18:16.740764 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8523
I20260807 06:18:16.752110 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8067
2026-08-07T06:18:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (914 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T06:18:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:18:16Z Disabled control of system clock
I20260807 06:18:16.787472 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:41879
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:41879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:18:16.901140 8714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:16.901417 8714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:16.901453 8714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:16.905368 8714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:18:16.905422 8714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:16.905437 8714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:16.905454 8714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:18:16.905469 8714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:18:16.910074 8714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:41879
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:41879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:16.911218 8714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:16.912590 8714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:16.921074 8723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.921134 8729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:16.921072 8726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:16.921208 8714 server_base.cc:1034] running on GCE node
I20260807 06:18:16.922008 8714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:16.923308 8714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:16.924526 8714 hybrid_clock.cc:648] HybridClock initialized: now 1786083496924499 us; error 44 us; skew 500 ppm
I20260807 06:18:16.926702 8714 webserver.cc:460] Webserver started at http://127.26.252.126:35313/ using document root <none> and password file <none>
I20260807 06:18:16.927397 8714 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:16.927510 8714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:16.927783 8714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:16.930043 8714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "1d2ff1295f43430ea6d82e6dec7c2606"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "899ad852a7cf08b8a3410f7afd7f3ba2"
server_key_iv: "ceab0fd50258bbe20a243d2adc52e5c1"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.930727 8714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "1d2ff1295f43430ea6d82e6dec7c2606"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "899ad852a7cf08b8a3410f7afd7f3ba2"
server_key_iv: "ceab0fd50258bbe20a243d2adc52e5c1"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.934826 8714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 06:18:16.937637 8738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:16.939142 8714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:16.939309 8714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "1d2ff1295f43430ea6d82e6dec7c2606"
format_stamp: "Formatted at 2026-08-07 06:18:16 on dist-test-slave-68xk"
server_key: "899ad852a7cf08b8a3410f7afd7f3ba2"
server_key_iv: "ceab0fd50258bbe20a243d2adc52e5c1"
server_key_version: "encryptionkey@0"
I20260807 06:18:16.939440 8714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:16.944506 8714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:16.945200 8714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:16.945416 8714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:16.953243 8714 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:41879
I20260807 06:18:16.953271 8811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:41879 every 8 connection(s)
I20260807 06:18:16.954299 8714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:18:16.957685 8812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:16.963284 8812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606: Bootstrap starting.
I20260807 06:18:16.963773 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8714
I20260807 06:18:16.963914 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:18:16.964198 27633 external_mini_cluster.cc:1428] Setting key a3b0f2788de52292896b2550d7551188
I20260807 06:18:16.966046 8812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:16.966882 8812 log.cc:824] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:16.969278 8812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606: No bootstrap required, opened a new log
I20260807 06:18:16.970253 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:16.965682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54052 (local address 127.26.252.126:41879)
0807 06:18:16.966451 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:16.966479 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:16.966518 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:18:16.967281 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:16.967300 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:16.967600 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:16.967909 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:16.968819 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:16.968824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:16.968837 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:16.968847 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:16.968905 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:16.968922 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:16.969019 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:16.969223 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 06:18:16.969514 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":164,"threads_started":1}
I20260807 06:18:16.972791 8812 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } }
I20260807 06:18:16.973037 8812 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:16.973117 8812 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d2ff1295f43430ea6d82e6dec7c2606, State: Initialized, Role: FOLLOWER
I20260807 06:18:16.973580 8812 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } }
I20260807 06:18:16.973734 8812 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:18:16.973824 8812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:18:16.973925 8812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:16.974946 8812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } }
I20260807 06:18:16.975289 8812 leader_election.cc:302] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d2ff1295f43430ea6d82e6dec7c2606; no voters:
I20260807 06:18:16.975606 8812 leader_election.cc:288] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:18:16.975837 8817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:18:16.976068 8817 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [term 1 LEADER]: Becoming Leader. State: Replica: 1d2ff1295f43430ea6d82e6dec7c2606, State: Running, Role: LEADER
I20260807 06:18:16.976390 8817 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } }
I20260807 06:18:16.977005 8812 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:18:16.978192 8818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } } }
I20260807 06:18:16.978332 8818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:16.978650 8821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d2ff1295f43430ea6d82e6dec7c2606. Latest consensus state: current_term: 1 leader_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d2ff1295f43430ea6d82e6dec7c2606" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 41879 } } }
I20260807 06:18:16.978741 8821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:16.978855 8830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:18:16.982214 8830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:18:16.988348 8830 catalog_manager.cc:1347] Generated new cluster ID: c9085c1389cb4e3ea53f5844670eaa74
I20260807 06:18:16.988523 8830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:18:17.005705 8830 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:18:17.006346 8830 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:18:17.016994 8830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d2ff1295f43430ea6d82e6dec7c2606: Generated new TSK 0
I20260807 06:18:17.017880 8830 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:18:17.029484 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--builtin_ntp_servers=127.26.252.84:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:18:17.145793 8844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:17.146063 8844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:17.146148 8844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:17.150305 8844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:17.150363 8844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:17.150434 8844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:18:17.155259 8844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:17.156347 8844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:17.157795 8844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:17.167694 8854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:17.167724 8856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:17.167722 8853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:17.167855 8844 server_base.cc:1034] running on GCE node
I20260807 06:18:17.168444 8844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:17.169144 8844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:17.170360 8844 hybrid_clock.cc:648] HybridClock initialized: now 1786083497170329 us; error 44 us; skew 500 ppm
I20260807 06:18:17.172394 8844 webserver.cc:460] Webserver started at http://127.26.252.65:41493/ using document root <none> and password file <none>
I20260807 06:18:17.173025 8844 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:17.173137 8844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:17.173408 8844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:17.175623 8844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "998e17e95af040598cf953e6704a888f"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "8b76a144b30ec21879dc7e9fda9d913a"
server_key_iv: "8e21c01621a3b2e034f21689888deeae"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.176223 8844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "998e17e95af040598cf953e6704a888f"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "8b76a144b30ec21879dc7e9fda9d913a"
server_key_iv: "8e21c01621a3b2e034f21689888deeae"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.180514 8844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:18:17.183185 8866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.184444 8844 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:18:17.184612 8844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "998e17e95af040598cf953e6704a888f"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "8b76a144b30ec21879dc7e9fda9d913a"
server_key_iv: "8e21c01621a3b2e034f21689888deeae"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.184763 8844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:17.191476 8844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:17.192109 8844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:17.192319 8844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:17.192895 8844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:17.193835 8844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:17.193912 8844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.193979 8844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:17.194031 8844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.203596 8844 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:42261
I20260807 06:18:17.203620 9016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:42261 every 8 connection(s)
I20260807 06:18:17.204573 8844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:18:17.206931 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 8844
I20260807 06:18:17.207068 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:18:17.207355 27633 external_mini_cluster.cc:1428] Setting key a15c8b6e9924e83253f654b5f0b7bb10
I20260807 06:18:17.209336 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--builtin_ntp_servers=127.26.252.84:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 06:18:17.211131 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.206521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35743 (local address 127.26.252.126:41879)
0807 06:18:17.206695 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:17.206701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:17.207934 (+ 1233us) server_negotiation.cc:407] Connection header received
0807 06:18:17.209289 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:17.209292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:17.209333 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:17.209413 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:17.210630 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:17.210634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:17.210637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:17.210650 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:17.210681 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:17.210696 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:17.210797 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:17.210951 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 06:18:17.210998 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:18:17.211982 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.206988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41879 (local address 127.26.252.65:35743)
0807 06:18:17.207778 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:17.207832 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:17.209061 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:17.209578 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:17.209585 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:17.209676 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:17.210306 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:17.210308 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:17.210354 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:17.210441 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:17.210784 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:17.210794 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:17.210799 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:18:17.210991 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 06:18:17.211247 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":157,"threads_started":1}
I20260807 06:18:17.213321 9017 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41879
I20260807 06:18:17.213572 9017 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:17.214144 9017 heartbeater.cc:511] Master 127.26.252.126:41879 requested a full tablet report, sending...
I20260807 06:18:17.215859 8762 ts_manager.cc:194] Registered new tserver with Master: 998e17e95af040598cf953e6704a888f (127.26.252.65:42261)
W20260807 06:18:17.324812 9020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:17.325156 9020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:17.325240 9020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:17.329612 9020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:17.329700 9020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:17.329797 9020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:18:17.334563 9020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:17.335705 9020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:17.337248 9020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:17.347337 9026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:17.347337 9025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:17.347293 9029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:17.347594 9020 server_base.cc:1034] running on GCE node
I20260807 06:18:17.348065 9020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:17.348773 9020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:17.349996 9020 hybrid_clock.cc:648] HybridClock initialized: now 1786083497349973 us; error 38 us; skew 500 ppm
I20260807 06:18:17.352265 9020 webserver.cc:460] Webserver started at http://127.26.252.66:35005/ using document root <none> and password file <none>
I20260807 06:18:17.352917 9020 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:17.353027 9020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:17.353288 9020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:17.355688 9020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "5fa1ab7a23cd4dfbb446e7945603470b"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "2540a650cd425a1118d1d737df0d4234"
server_key_iv: "87ae3e0b16939395668696810caf4c4c"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.356317 9020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "5fa1ab7a23cd4dfbb446e7945603470b"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "2540a650cd425a1118d1d737df0d4234"
server_key_iv: "87ae3e0b16939395668696810caf4c4c"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.360399 9020 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:18:17.363260 9036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.364784 9020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:17.364933 9020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "5fa1ab7a23cd4dfbb446e7945603470b"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "2540a650cd425a1118d1d737df0d4234"
server_key_iv: "87ae3e0b16939395668696810caf4c4c"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.365070 9020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:17.370121 9020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:17.370833 9020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:17.371032 9020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:17.371629 9020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:17.372597 9020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:17.372687 9020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.372757 9020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:17.372794 9020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.383330 9020 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:40873
I20260807 06:18:17.383360 9183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:40873 every 8 connection(s)
I20260807 06:18:17.384276 9020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:18:17.387674 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9020
I20260807 06:18:17.387820 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:18:17.388156 27633 external_mini_cluster.cc:1428] Setting key 0f6a8c7ae768703b32fbfd1df527681e
I20260807 06:18:17.390566 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--builtin_ntp_servers=127.26.252.84:36769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 06:18:17.391137 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.386193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:43073 (local address 127.26.252.126:41879)
0807 06:18:17.386342 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:17.386346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:17.387582 (+ 1236us) server_negotiation.cc:407] Connection header received
0807 06:18:17.389251 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:17.389254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:17.389292 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:17.389362 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:17.390645 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:17.390649 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:17.390652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:17.390673 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:17.390699 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:17.390710 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:17.390812 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:17.390955 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 06:18:17.391002 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:18:17.392035 9186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.386706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41879 (local address 127.26.252.66:43073)
0807 06:18:17.387430 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:17.387472 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:17.389000 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:17.389554 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:17.389563 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:17.389722 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:17.390328 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:17.390330 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:17.390370 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:17.390487 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:17.390812 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:17.390825 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:17.390833 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:18:17.390998 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 06:18:17.391322 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
I20260807 06:18:17.393289 9184 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41879
I20260807 06:18:17.393528 9184 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:17.393998 9184 heartbeater.cc:511] Master 127.26.252.126:41879 requested a full tablet report, sending...
I20260807 06:18:17.395144 8762 ts_manager.cc:194] Registered new tserver with Master: 5fa1ab7a23cd4dfbb446e7945603470b (127.26.252.66:40873)
W20260807 06:18:17.507730 9187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:17.508081 9187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:17.508128 9187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:17.512197 9187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:17.512261 9187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:17.512318 9187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:18:17.517189 9187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:36769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:41879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:17.518546 9187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:17.519999 9187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:17.529873 9196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:17.529865 9195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:17.530004 9187 server_base.cc:1034] running on GCE node
W20260807 06:18:17.529865 9198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:17.530699 9187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:17.531311 9187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:17.532486 9187 hybrid_clock.cc:648] HybridClock initialized: now 1786083497532501 us; error 68 us; skew 500 ppm
I20260807 06:18:17.534562 9187 webserver.cc:460] Webserver started at http://127.26.252.67:36907/ using document root <none> and password file <none>
I20260807 06:18:17.535156 9187 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:17.535223 9187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:17.535447 9187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:17.537539 9187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "9a0f3d894eab401a9e6b53cdcca0be82"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "910f45fef822fd15c3ba4445eb326a8e"
server_key_iv: "94c35498cfc25254496d3e950e853b8f"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.538244 9187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "9a0f3d894eab401a9e6b53cdcca0be82"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "910f45fef822fd15c3ba4445eb326a8e"
server_key_iv: "94c35498cfc25254496d3e950e853b8f"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.541996 9187 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:18:17.545185 9210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.546557 9187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:18:17.546694 9187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "9a0f3d894eab401a9e6b53cdcca0be82"
format_stamp: "Formatted at 2026-08-07 06:18:17 on dist-test-slave-68xk"
server_key: "910f45fef822fd15c3ba4445eb326a8e"
server_key_iv: "94c35498cfc25254496d3e950e853b8f"
server_key_version: "encryptionkey@0"
I20260807 06:18:17.546808 9187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:17.551330 9187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:17.551939 9187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:17.552130 9187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:17.552677 9187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:17.553555 9187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:17.553627 9187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.553692 9187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:17.553740 9187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:17.562736 9187 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:34435
I20260807 06:18:17.562767 9359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:34435 every 8 connection(s)
I20260807 06:18:17.563596 9187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:18:17.569182 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9187
I20260807 06:18:17.569329 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:18:17.569633 27633 external_mini_cluster.cc:1428] Setting key bb256fd4d208d73fe9906e6fc11840a4
I20260807 06:18:17.570372 8815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.565710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:55645 (local address 127.26.252.126:41879)
0807 06:18:17.565850 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:17.565853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:17.566888 (+ 1035us) server_negotiation.cc:407] Connection header received
0807 06:18:17.568352 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:17.568358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:17.568410 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:17.568499 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:17.569753 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:17.569757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:17.569760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:18:17.569772 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:17.569792 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:18:17.569801 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:17.569911 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:17.570173 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 06:18:17.570231 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:18:17.571329 9363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:17.566027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:41879 (local address 127.26.252.67:55645)
0807 06:18:17.566757 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:17.566799 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:17.567994 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:17.568663 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:17.568670 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:17.568760 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:17.569484 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:18:17.569487 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:17.569532 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:18:17.569601 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:17.569892 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:17.569901 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:17.569907 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:18:17.570116 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 06:18:17.570373 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260807 06:18:17.572458 9361 heartbeater.cc:347] Connected to a master server at 127.26.252.126:41879
I20260807 06:18:17.572737 9361 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:17.573165 9361 heartbeater.cc:511] Master 127.26.252.126:41879 requested a full tablet report, sending...
I20260807 06:18:17.574303 8760 ts_manager.cc:194] Registered new tserver with Master: 9a0f3d894eab401a9e6b53cdcca0be82 (127.26.252.67:34435)
I20260807 06:18:17.584267 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:18:17.587144 8815 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:18:17.586320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54060 (local address 127.26.252.126:41879)
0807 06:18:17.586488 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:17.586491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:17.586663 (+ 172us) server_negotiation.cc:407] Connection header received
0807 06:18:17.586736 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:17.586738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:17.586771 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:17.586842 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:17.587042 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54060: BlockingRecv error: recv got EOF from 127.0.0.1:54060 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:18:17.587503 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8844
I20260807 06:18:17.600327 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9020
I20260807 06:18:17.621881 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9187
I20260807 06:18:17.631533 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 8714
2026-08-07T06:18:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (881 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:18:17 dist-test-slave-68xk krb5kdc[9375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:18:17 dist-test-slave-68xk krb5kdc[9375](info): set up 2 sockets
Aug 07 06:18:17 dist-test-slave-68xk krb5kdc[9375](info): commencing operation
krb5kdc: starting...
W20260807 06:18:18.855993 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:18:18 dist-test-slave-68xk krb5kdc[9375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:18:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:18:18.990950 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44775
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:19.128129 9394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:19.128392 9394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:19.128432 9394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:19.132527 9394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:18:19.132583 9394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:19.132602 9394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:19.132619 9394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:18:19.132634 9394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:18:19.137732 9394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:19.138746 9394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:19.139725 9394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:19.148451 9404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.148584 9394 server_base.cc:1034] running on GCE node
W20260807 06:18:19.148465 9402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.148864 9401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.149461 9394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:19.150600 9394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:19.151798 9394 hybrid_clock.cc:648] HybridClock initialized: now 1786083499151771 us; error 43 us; skew 500 ppm
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:19.154704 9394 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:18:19.155514 9394 webserver.cc:460] Webserver started at http://127.26.252.126:43275/ using document root <none> and password file <none>
I20260807 06:18:19.156028 9394 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:19.156088 9394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:19.156270 9394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:19.158782 9394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "139795567aaa42f98a7f8a4311079c13"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "612556b6d09c33f293869df20eeee3c9"
server_key_iv: "250e3f08fbcad9420673bedf0707650b"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.159310 9394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "139795567aaa42f98a7f8a4311079c13"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "612556b6d09c33f293869df20eeee3c9"
server_key_iv: "250e3f08fbcad9420673bedf0707650b"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.163132 9394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:18:19.165601 9414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.166999 9394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:18:19.167145 9394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "139795567aaa42f98a7f8a4311079c13"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "612556b6d09c33f293869df20eeee3c9"
server_key_iv: "250e3f08fbcad9420673bedf0707650b"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.167255 9394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:19.180294 9394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:19.183650 9394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:19.183869 9394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:19.191568 9394 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44775
I20260807 06:18:19.191606 9488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44775 every 8 connection(s)
I20260807 06:18:19.192579 9394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:18:19.195449 9489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:19.199409 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9394
I20260807 06:18:19.199546 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:18:19.199855 27633 external_mini_cluster.cc:1428] Setting key 4b0f7c9cfab619d8b9acb7d824c4c9e3
I20260807 06:18:19.201678 9489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: Bootstrap starting.
I20260807 06:18:19.204077 9489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:19.204845 9489 log.cc:824] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:19.206904 9489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: No bootstrap required, opened a new log
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:18:19.210355 9489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } }
I20260807 06:18:19.210667 9489 raft_consensus.cc:374] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:19.210731 9489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 139795567aaa42f98a7f8a4311079c13, State: Initialized, Role: FOLLOWER
I20260807 06:18:19.211227 9489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } }
I20260807 06:18:19.211398 9489 raft_consensus.cc:388] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:18:19.211491 9489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:18:19.211608 9489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:19.212509 9489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } }
I20260807 06:18:19.212862 9489 leader_election.cc:302] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 139795567aaa42f98a7f8a4311079c13; no voters:
I20260807 06:18:19.213228 9489 leader_election.cc:288] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:18:19.213315 9498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:18:19.213505 9498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [term 1 LEADER]: Becoming Leader. State: Replica: 139795567aaa42f98a7f8a4311079c13, State: Running, Role: LEADER
I20260807 06:18:19.213799 9498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } }
I20260807 06:18:19.214571 9489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:18:19.215644 9501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 139795567aaa42f98a7f8a4311079c13. Latest consensus state: current_term: 1 leader_uuid: "139795567aaa42f98a7f8a4311079c13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } } }
I20260807 06:18:19.215696 9500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "139795567aaa42f98a7f8a4311079c13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "139795567aaa42f98a7f8a4311079c13" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44775 } } }
I20260807 06:18:19.215751 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.201449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50280 (local address 127.26.252.126:44775)
0807 06:18:19.201975 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.201990 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.202029 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:18:19.202798 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.202818 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.203162 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.203516 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:19.204440 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.205550 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.206454 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.206942 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.207124 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.209722 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:19.209727 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:19.209747 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:19.209775 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:19.211895 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.212369 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.212380 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.212385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.212504 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.212827 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.212831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.212833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.213297 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:19.213523 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.214337 (+ 814us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.214670 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":149,"threads_started":1}
I20260807 06:18:19.215792 9500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [sys.catalog]: This master's current role is: LEADER
I20260807 06:18:19.215770 9501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13 [sys.catalog]: This master's current role is: LEADER
W20260807 06:18:19.219496 9519 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:18:19.219599 9519 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:18:19.219671 9509 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:18:19.220345 9509 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:18:19.225577 9509 catalog_manager.cc:1347] Generated new cluster ID: 49a5b84b1fbf4acb8965b2d51fc16148
I20260807 06:18:19.225646 9509 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:18:19.239699 9509 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:18:19.240995 9509 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:18:19.247951 9509 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: Generated new TSK 0
I20260807 06:18:19.248775 9509 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:18:19.281371 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:19.396180 9526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:19.396483 9526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:19.396560 9526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:19.400511 9526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:19.400601 9526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:19.400689 9526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:18:19.405928 9526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:19.407052 9526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:19.408109 9526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:19.418455 9533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.418444 9531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.418560 9526 server_base.cc:1034] running on GCE node
W20260807 06:18:19.418466 9535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.419134 9526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:19.419727 9526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:19.420898 9526 hybrid_clock.cc:648] HybridClock initialized: now 1786083499420867 us; error 42 us; skew 500 ppm
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:19.423816 9526 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:18:19.424747 9526 webserver.cc:460] Webserver started at http://127.26.252.65:46031/ using document root <none> and password file <none>
I20260807 06:18:19.425299 9526 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:19.425359 9526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:19.425526 9526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:19.427590 9526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "54153ec8728947cda3cf17b08832cb55"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "51e432010aac9c3b85a978b04b2b9444"
server_key_iv: "4974a0cdba5b5b8848e54ddb552ea109"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.428172 9526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "54153ec8728947cda3cf17b08832cb55"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "51e432010aac9c3b85a978b04b2b9444"
server_key_iv: "4974a0cdba5b5b8848e54ddb552ea109"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.431979 9526 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:18:19.434489 9544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.435702 9526 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:18:19.435801 9526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "54153ec8728947cda3cf17b08832cb55"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "51e432010aac9c3b85a978b04b2b9444"
server_key_iv: "4974a0cdba5b5b8848e54ddb552ea109"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.435935 9526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:19.446620 9526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:19.449891 9526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:19.450099 9526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:19.450778 9526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:19.451598 9526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:19.451645 9526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.451710 9526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:19.451745 9526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.461346 9526 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:35499
I20260807 06:18:19.461462 9699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:35499 every 8 connection(s)
I20260807 06:18:19.462399 9526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:18:19.468624 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9526
I20260807 06:18:19.468734 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:18:19.469010 27633 external_mini_cluster.cc:1428] Setting key 7bce182b2086b611af83529a6101be6e
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:18:19.478366 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.464469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:55337 (local address 127.26.252.126:44775)
0807 06:18:19.464617 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.464621 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.465519 (+ 898us) server_negotiation.cc:407] Connection header received
0807 06:18:19.466980 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.466983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.467034 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.467133 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:19.468289 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.469019 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.470616 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.470932 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.471054 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.474272 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:19.474275 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:19.474277 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:19.474303 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:19.475838 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.476561 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.476564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.476566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.476645 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.477094 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.477096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.477097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.477292 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:19.477368 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.478112 (+ 744us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.478217 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:18:19.479764 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.464856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44775 (local address 127.26.252.65:55337)
0807 06:18:19.465347 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.465391 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.466751 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.467294 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.467300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.467650 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:19.468125 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.468138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.469225 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.469229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.470480 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.470493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.471132 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.471135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.471293 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.471964 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:19.471983 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:19.474046 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:19.475986 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.475995 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.476014 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.476447 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.476753 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.476760 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.476765 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.476980 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.477415 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:19.477425 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:19.477820 (+ 395us) client_negotiation.cc:769] Sending connection context
0807 06:18:19.478089 (+ 269us) client_negotiation.cc:240] Negotiation successful
0807 06:18:19.478529 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":147,"threads_started":1}
I20260807 06:18:19.481172 9700 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44775
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:18:19.481464 9700 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:19.481972 9700 heartbeater.cc:511] Master 127.26.252.126:44775 requested a full tablet report, sending...
I20260807 06:18:19.483608 9439 ts_manager.cc:194] Registered new tserver with Master: 54153ec8728947cda3cf17b08832cb55 (127.26.252.65:35499)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:18:19.484933 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:55337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:18:19.502372 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:19.621713 9706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:19.621994 9706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:19.622069 9706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:19.626232 9706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:19.626318 9706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:19.626406 9706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:18:19.631909 9706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:19.632917 9706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:19.633924 9706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:19.643708 9717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.643610 9715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.643618 9713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.643965 9706 server_base.cc:1034] running on GCE node
I20260807 06:18:19.644362 9706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:19.644994 9706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:19.646175 9706 hybrid_clock.cc:648] HybridClock initialized: now 1786083499646149 us; error 40 us; skew 500 ppm
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:19.649060 9706 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:18:19.649917 9706 webserver.cc:460] Webserver started at http://127.26.252.66:44701/ using document root <none> and password file <none>
I20260807 06:18:19.650549 9706 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:19.650619 9706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:19.650854 9706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:19.652870 9706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "62620928727d497d82e732775609381f"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "254ca9ad55e24badbaecaa74daedc5cc"
server_key_iv: "a8d1e06f36de1bdd22dd5e3e3419f266"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.653435 9706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "62620928727d497d82e732775609381f"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "254ca9ad55e24badbaecaa74daedc5cc"
server_key_iv: "a8d1e06f36de1bdd22dd5e3e3419f266"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.657207 9706 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 06:18:19.659735 9725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.660928 9706 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:18:19.661079 9706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "62620928727d497d82e732775609381f"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "254ca9ad55e24badbaecaa74daedc5cc"
server_key_iv: "a8d1e06f36de1bdd22dd5e3e3419f266"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.661191 9706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:19.687176 9706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:19.690693 9706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:19.690923 9706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:19.691560 9706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:19.692426 9706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:19.692502 9706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.692570 9706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:19.692622 9706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.701929 9706 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:34407
I20260807 06:18:19.701964 9880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:34407 every 8 connection(s)
I20260807 06:18:19.702919 9706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:18:19.709656 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9706
I20260807 06:18:19.709823 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:18:19.710121 27633 external_mini_cluster.cc:1428] Setting key 0f6683877fc8618790c6805ef0c7efe6
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:18:19.719080 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.704903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:37069 (local address 127.26.252.126:44775)
0807 06:18:19.705057 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.705061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.705997 (+ 936us) server_negotiation.cc:407] Connection header received
0807 06:18:19.707481 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.707485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.707545 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.707625 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:19.708804 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.709355 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.710833 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.711138 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.711239 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.714503 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:19.714506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:19.714508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:19.714536 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:19.716389 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.717000 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.717011 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.717016 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.717145 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.717644 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.717651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.717654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.717937 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:19.718051 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.718843 (+ 792us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.718954 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:18:19.720409 9884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.705356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44775 (local address 127.26.252.66:37069)
0807 06:18:19.705833 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.705877 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.707228 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.707799 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.707806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.708173 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:19.708640 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.708653 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.709492 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.709495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.710672 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.710684 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.711405 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.711409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.711607 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.712276 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:19.712293 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:19.714259 (+ 1966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:19.716537 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.716543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.716559 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.716891 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.717280 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.717284 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.717285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.717495 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.718100 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:19.718106 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:19.718529 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 06:18:19.718776 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 06:18:19.719194 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":125,"threads_started":1}
I20260807 06:18:19.721735 9881 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44775
I20260807 06:18:19.722007 9881 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:18:19.722637 9881 heartbeater.cc:511] Master 127.26.252.126:44775 requested a full tablet report, sending...
I20260807 06:18:19.723806 9439 ts_manager.cc:194] Registered new tserver with Master: 62620928727d497d82e732775609381f (127.26.252.66:34407)
I20260807 06:18:19.724400 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:37069
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:18:19.747444 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:18:19.863533 9887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:18:19.863822 9887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:18:19.863895 9887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:18:19.868036 9887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:18:19.868120 9887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:18:19.868223 9887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:18:19.873661 9887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:18:19.874820 9887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:18:19.875890 9887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:18:19.886230 9897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.886307 9899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:18:19.886294 9895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:18:19.886656 9887 server_base.cc:1034] running on GCE node
I20260807 06:18:19.887135 9887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:18:19.887885 9887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:18:19.889067 9887 hybrid_clock.cc:648] HybridClock initialized: now 1786083499889041 us; error 38 us; skew 500 ppm
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:18:19.892257 9887 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:18:19.893234 9887 webserver.cc:460] Webserver started at http://127.26.252.67:44303/ using document root <none> and password file <none>
I20260807 06:18:19.893873 9887 fs_manager.cc:359] Metadata directory not provided
I20260807 06:18:19.893981 9887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:18:19.894258 9887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:18:19.896589 9887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "934cb563bbf44978b7cce7470400ca00"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "9d59c5d759e5e5dc137f6fc5e70266e9"
server_key_iv: "4376c4faba97bace81341699a94a9719"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.897253 9887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "934cb563bbf44978b7cce7470400ca00"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "9d59c5d759e5e5dc137f6fc5e70266e9"
server_key_iv: "4376c4faba97bace81341699a94a9719"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.901505 9887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:18:19.904342 9908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.905709 9887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:18:19.905867 9887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "934cb563bbf44978b7cce7470400ca00"
format_stamp: "Formatted at 2026-08-07 06:18:19 on dist-test-slave-68xk"
server_key: "9d59c5d759e5e5dc137f6fc5e70266e9"
server_key_iv: "4376c4faba97bace81341699a94a9719"
server_key_version: "encryptionkey@0"
I20260807 06:18:19.905998 9887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:18:19.918298 9887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:18:19.922030 9887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:18:19.922277 9887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:18:19.922987 9887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:18:19.923892 9887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:18:19.923975 9887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.924055 9887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:18:19.924094 9887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:18:19.933928 9887 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:40135
I20260807 06:18:19.934027 10058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:40135 every 8 connection(s)
I20260807 06:18:19.934999 9887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:18:19.935433 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 9887
I20260807 06:18:19.935570 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:18:19.935909 27633 external_mini_cluster.cc:1428] Setting key b773effd73cfcff6395545efcd284cc3
Aug 07 06:18:19 dist-test-slave-68xk krb5kdc[9375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083499, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:18:19.954839 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.937190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:46205 (local address 127.26.252.126:44775)
0807 06:18:19.937372 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.937384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.938254 (+ 870us) server_negotiation.cc:407] Connection header received
0807 06:18:19.940344 (+ 2090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.940350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.940418 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.940544 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:19.943550 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.944336 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.946575 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.946826 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.946918 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.950777 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:19.950781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:19.950783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:19.950809 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:19.952533 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.953116 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.953120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.953122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.953220 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.953609 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.953613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.953615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.953818 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:19.953942 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.954513 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.954649 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:18:19.955680 10064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.937616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44775 (local address 127.26.252.67:46205)
0807 06:18:19.938109 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.938164 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.940051 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.940799 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.940811 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.942551 (+ 1740us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:18:19.943377 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.943403 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.944498 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.944504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.946302 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.946318 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.947012 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.947018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.947279 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.948086 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:18:19.948111 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:18:19.950557 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:18:19.952674 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.952680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.952703 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.952991 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.953328 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:18:19.953333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:18:19.953335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:18:19.953491 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:18:19.953941 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:18:19.953948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:18:19.954218 (+ 270us) client_negotiation.cc:769] Sending connection context
0807 06:18:19.954421 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 06:18:19.954807 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":139,"threads_started":1}
I20260807 06:18:19.956949 10059 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44775
I20260807 06:18:19.957234 10059 heartbeater.cc:464] Registering TS with master...
I20260807 06:18:19.957872 10059 heartbeater.cc:511] Master 127.26.252.126:44775 requested a full tablet report, sending...
I20260807 06:18:19.959059 9439 ts_manager.cc:194] Registered new tserver with Master: 934cb563bbf44978b7cce7470400ca00 (127.26.252.67:40135)
I20260807 06:18:19.959708 9439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:46205
I20260807 06:18:19.962853 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:18:19.973745 9493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.965232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.26.252.126:44775)
0807 06:18:19.965370 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.965375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.965593 (+ 218us) server_negotiation.cc:407] Connection header received
0807 06:18:19.965764 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.965767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.965815 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.965911 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:18:19.966754 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.967308 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.968228 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.968483 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.968628 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.970117 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:18:19.970121 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:18:19.970124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:18:19.970152 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:18:19.971893 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.972363 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.972367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.972369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.972459 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:18:19.972776 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:18:19.972781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:18:19.972783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:18:19.973010 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:18:19.973167 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.973429 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.973558 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:18:19.976888 9439 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:18:19.980230 9439 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:18:19.998085 10079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.990689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35499 (local address 127.0.0.1:39298)
0807 06:18:19.992061 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.992078 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.992196 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.992702 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.992705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.992727 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:18:19.992827 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.992833 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.994894 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.994898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.996232 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.996244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.997488 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.997492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.997625 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.997675 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:18:19.997781 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:18:19.997909 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1281,"mutex_wait_us":34,"thread_start_us":120,"threads_started":1}
I20260807 06:18:19.998865 10080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.991540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39298 (local address 127.26.252.65:35499)
0807 06:18:19.991972 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.991979 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.992192 (+ 213us) server_negotiation.cc:407] Connection header received
0807 06:18:19.992309 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.992314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.992515 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.993362 (+ 847us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:18:19.993515 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.994757 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.996400 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.997339 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.998308 (+ 969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.998487 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.998549 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.998655 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":96,"threads_started":1}
I20260807 06:18:19.999158 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.989900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34714 (local address 127.26.252.66:34407)
0807 06:18:19.990653 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.990668 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.991254 (+ 586us) server_negotiation.cc:407] Connection header received
0807 06:18:19.991581 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.991588 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.991834 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.991982 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:18:19.992610 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.994385 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.997163 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.998078 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.998168 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.998392 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:19.998837 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 06:18:19.998952 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":137,"threads_started":1}
I20260807 06:18:19.999608 10078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.989804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:34407 (local address 127.0.0.1:34714)
0807 06:18:19.991085 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.991140 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.991357 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.992277 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.992283 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.992311 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:18:19.992448 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.992454 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.994588 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.994591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.997014 (+ 2423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.997025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.998552 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.998557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.998661 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:19.998684 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:18:19.999344 (+ 660us) client_negotiation.cc:240] Negotiation successful
0807 06:18:19.999461 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"mutex_wait_us":815,"thread_start_us":96,"threads_started":1}
I20260807 06:18:20.003783 10075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.991085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40135 (local address 127.0.0.1:50010)
0807 06:18:19.992413 (+ 1328us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:19.992427 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:19.992501 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:19.993325 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:19.993331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:19.993356 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:18:19.993481 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.993490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.995370 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:19.995376 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:19.996857 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:19.996871 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.003292 (+ 6421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.003297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:20.003413 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.003447 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 06:18:20.003541 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:18:20.003632 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1254,"thread_start_us":94,"threads_started":1}
I20260807 06:18:20.003389 9609 tablet_service.cc:1467] Processing CreateTablet for tablet d09f03f64b4a44f9a31a144cb9499144 (DEFAULT_TABLE table=test-table [id=d1678ca2bc0647bfbbf56bf5cf6e5db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:18:20.004446 10081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:19.991564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50010 (local address 127.26.252.67:40135)
0807 06:18:19.992807 (+ 1243us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:19.992822 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:19.992848 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:18:19.992928 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:19.992935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:19.993144 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:19.993661 (+ 517us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:18:19.993862 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:19.995203 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.001925 (+ 6722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.003119 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.003268 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.003426 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:20.004120 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 06:18:20.004252 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1102,"thread_start_us":193,"threads_started":1}
I20260807 06:18:20.004812 9609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f03f64b4a44f9a31a144cb9499144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:20.005067 9796 tablet_service.cc:1467] Processing CreateTablet for tablet d09f03f64b4a44f9a31a144cb9499144 (DEFAULT_TABLE table=test-table [id=d1678ca2bc0647bfbbf56bf5cf6e5db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:18:20.006474 9796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f03f64b4a44f9a31a144cb9499144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:20.007784 9970 tablet_service.cc:1467] Processing CreateTablet for tablet d09f03f64b4a44f9a31a144cb9499144 (DEFAULT_TABLE table=test-table [id=d1678ca2bc0647bfbbf56bf5cf6e5db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:18:20.008927 9970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f03f64b4a44f9a31a144cb9499144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:18:20.015491 10082 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: Bootstrap starting.
I20260807 06:18:20.017489 10084 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Bootstrap starting.
I20260807 06:18:20.018340 10082 tablet_bootstrap.cc:654] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:20.019348 10082 log.cc:824] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:20.020169 10086 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Bootstrap starting.
I20260807 06:18:20.021363 10084 tablet_bootstrap.cc:654] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:20.022104 10086 tablet_bootstrap.cc:654] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Neither blocks nor log segments found. Creating new log.
I20260807 06:18:20.022400 10084 log.cc:824] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:20.023490 10086 log.cc:824] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Log is configured to *not* fsync() on all Append() calls
I20260807 06:18:20.025070 10084 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: No bootstrap required, opened a new log
I20260807 06:18:20.025309 10084 ts_tablet_manager.cc:1397] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 06:18:20.025470 10082 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: No bootstrap required, opened a new log
I20260807 06:18:20.025717 10082 ts_tablet_manager.cc:1397] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260807 06:18:20.027841 10086 tablet_bootstrap.cc:492] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: No bootstrap required, opened a new log
I20260807 06:18:20.028079 10086 ts_tablet_manager.cc:1397] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:18:20.030258 10082 raft_consensus.cc:348] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.030571 10082 raft_consensus.cc:374] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:20.030627 10082 raft_consensus.cc:729] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54153ec8728947cda3cf17b08832cb55, State: Initialized, Role: FOLLOWER
I20260807 06:18:20.030864 10084 raft_consensus.cc:348] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.031185 10084 raft_consensus.cc:374] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:20.031162 10082 consensus_queue.cc:260] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.031272 10084 raft_consensus.cc:729] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62620928727d497d82e732775609381f, State: Initialized, Role: FOLLOWER
I20260807 06:18:20.031833 10084 consensus_queue.cc:260] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.032258 10082 ts_tablet_manager.cc:1428] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:18:20.032630 9700 heartbeater.cc:503] Master 127.26.252.126:44775 was elected leader, sending a full tablet report...
I20260807 06:18:20.032996 10084 ts_tablet_manager.cc:1428] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260807 06:18:20.033403 9881 heartbeater.cc:503] Master 127.26.252.126:44775 was elected leader, sending a full tablet report...
I20260807 06:18:20.033715 10086 raft_consensus.cc:348] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.034034 10086 raft_consensus.cc:374] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:18:20.034127 10086 raft_consensus.cc:729] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934cb563bbf44978b7cce7470400ca00, State: Initialized, Role: FOLLOWER
I20260807 06:18:20.034607 10086 consensus_queue.cc:260] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.035761 10086 ts_tablet_manager.cc:1428] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:18:20.036151 10059 heartbeater.cc:503] Master 127.26.252.126:44775 was elected leader, sending a full tablet report...
I20260807 06:18:20.110157 10093 raft_consensus.cc:482] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:18:20.110466 10093 raft_consensus.cc:504] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.111809 10093 leader_election.cc:288] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54153ec8728947cda3cf17b08832cb55 (127.26.252.65:35499), 934cb563bbf44978b7cce7470400ca00 (127.26.252.67:40135)
I20260807 06:18:20.117081 10081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.112549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:37749 (local address 127.26.252.67:40135)
0807 06:18:20.112677 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:20.112681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:20.112845 (+ 164us) server_negotiation.cc:407] Connection header received
0807 06:18:20.113005 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:20.113008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:20.113053 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:20.113142 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:18:20.113459 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.114174 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.115677 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.116385 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.116506 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.116562 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:20.116850 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 06:18:20.116940 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:18:20.117405 10096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.112301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40135 (local address 127.26.252.66:37749)
0807 06:18:20.112749 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:20.112761 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:20.112887 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:20.113156 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:20.113159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:20.113178 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:18:20.113337 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:20.113342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.114324 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.114328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:20.115482 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:20.115493 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.116529 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.116534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:20.116686 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.116728 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 06:18:20.116818 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:18:20.116913 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":13,"spinlock_wait_cycles":29952,"thread_start_us":145,"threads_started":1}
I20260807 06:18:20.117573 9884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.112036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35499 (local address 127.26.252.66:37601)
0807 06:18:20.112212 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:20.112234 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:18:20.112363 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:18:20.113165 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:18:20.113169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:18:20.113193 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:18:20.113355 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:20.113365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.114672 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.114678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:20.116113 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:18:20.116128 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.117134 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.117139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:18:20.117257 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.117286 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 06:18:20.117387 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:18:20.117462 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:18:20.117606 10080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.112605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:37601 (local address 127.26.252.65:35499)
0807 06:18:20.112781 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:20.112787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:20.112806 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:18:20.112871 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:20.112876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:20.112938 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:20.113021 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:18:20.113508 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.114508 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.116287 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.116884 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.116996 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.117041 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:20.117419 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 06:18:20.117495 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:18:20.118432 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f03f64b4a44f9a31a144cb9499144" candidate_uuid: "62620928727d497d82e732775609381f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934cb563bbf44978b7cce7470400ca00" is_pre_election: true
I20260807 06:18:20.118432 9637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f03f64b4a44f9a31a144cb9499144" candidate_uuid: "62620928727d497d82e732775609381f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54153ec8728947cda3cf17b08832cb55" is_pre_election: true
I20260807 06:18:20.118772 9637 raft_consensus.cc:2454] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62620928727d497d82e732775609381f in term 0.
I20260807 06:18:20.118767 9993 raft_consensus.cc:2454] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62620928727d497d82e732775609381f in term 0.
I20260807 06:18:20.119275 9726 leader_election.cc:302] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62620928727d497d82e732775609381f, 934cb563bbf44978b7cce7470400ca00; no voters:
I20260807 06:18:20.119536 10093 raft_consensus.cc:2781] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:18:20.119629 10093 raft_consensus.cc:482] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:18:20.119688 10093 raft_consensus.cc:3037] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:20.120793 10093 raft_consensus.cc:504] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.121192 10093 leader_election.cc:288] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [CANDIDATE]: Term 1 election: Requested vote from peers 54153ec8728947cda3cf17b08832cb55 (127.26.252.65:35499), 934cb563bbf44978b7cce7470400ca00 (127.26.252.67:40135)
I20260807 06:18:20.121639 9993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f03f64b4a44f9a31a144cb9499144" candidate_uuid: "62620928727d497d82e732775609381f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934cb563bbf44978b7cce7470400ca00"
I20260807 06:18:20.121762 9993 raft_consensus.cc:3037] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:20.122215 9637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f03f64b4a44f9a31a144cb9499144" candidate_uuid: "62620928727d497d82e732775609381f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54153ec8728947cda3cf17b08832cb55"
I20260807 06:18:20.122339 9637 raft_consensus.cc:3037] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:18:20.123265 9993 raft_consensus.cc:2454] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62620928727d497d82e732775609381f in term 1.
I20260807 06:18:20.123560 9726 leader_election.cc:302] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62620928727d497d82e732775609381f, 934cb563bbf44978b7cce7470400ca00; no voters:
I20260807 06:18:20.123718 9637 raft_consensus.cc:2454] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62620928727d497d82e732775609381f in term 1.
I20260807 06:18:20.123766 10093 raft_consensus.cc:2781] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:18:20.123986 10093 raft_consensus.cc:686] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 1 LEADER]: Becoming Leader. State: Replica: 62620928727d497d82e732775609381f, State: Running, Role: LEADER
I20260807 06:18:20.124327 10093 consensus_queue.cc:237] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } }
I20260807 06:18:20.127661 9439 catalog_manager.cc:5495] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f reported cstate change: term changed from 0 to 1, leader changed from <none> to 62620928727d497d82e732775609381f (127.26.252.66). New cstate: current_term: 1 leader_uuid: "62620928727d497d82e732775609381f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62620928727d497d82e732775609381f" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260807 06:18:20.152938 10076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.149219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34722 (local address 127.26.252.66:34407)
0807 06:18:20.149360 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 06:18:20.149366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:18:20.149382 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:18:20.149478 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:18:20.149480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:18:20.149534 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:18:20.149671 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:18:20.149917 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.150533 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.151463 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:18:20.151694 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:18:20.151807 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:18:20.152115 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:18:20.152510 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:18:20.152668 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:18:20.152736 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 06:18:20.152794 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:18:20.159044 9993 raft_consensus.cc:1261] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 1 FOLLOWER]: Refusing update from remote peer 62620928727d497d82e732775609381f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:18:20.159099 9637 raft_consensus.cc:1261] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 1 FOLLOWER]: Refusing update from remote peer 62620928727d497d82e732775609381f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:18:20.159883 10097 consensus_queue.cc:1035] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [LEADER]: Connected to new peer: Peer: permanent_uuid: "934cb563bbf44978b7cce7470400ca00" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:18:20.160092 10093 consensus_queue.cc:1035] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [LEADER]: Connected to new peer: Peer: permanent_uuid: "54153ec8728947cda3cf17b08832cb55" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:18:20.167934 10101 mvcc.cc:205] Tried to move back new op lower bound from 7315798016643334144 to 7315798016511889408. Current Snapshot: MvccSnapshot[applied={T|T < 7315798016643334144}]
I20260807 06:18:20.171226 10102 mvcc.cc:205] Tried to move back new op lower bound from 7315798016643334144 to 7315798016511889408. Current Snapshot: MvccSnapshot[applied={T|T < 7315798016643334144 or (T in {7315798016643334144})}]
I20260807 06:18:20.175877 9439 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:18:20.176081 9439 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:18:20.178849 9439 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 139795567aaa42f98a7f8a4311079c13: Sending DeleteTablet for 3 replicas of tablet d09f03f64b4a44f9a31a144cb9499144
I20260807 06:18:20.179653 9796 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f03f64b4a44f9a31a144cb9499144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:18:20 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:34714
I20260807 06:18:20.179826 9970 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f03f64b4a44f9a31a144cb9499144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:18:20 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:50010
I20260807 06:18:20.180220 9609 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f03f64b4a44f9a31a144cb9499144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:18:20 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:39298
I20260807 06:18:20.180356 10111 tablet_replica.cc:330] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: stopping tablet replica
I20260807 06:18:20.180711 10111 raft_consensus.cc:2229] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:18:20.180724 10112 tablet_replica.cc:330] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55: stopping tablet replica
I20260807 06:18:20.181056 10111 raft_consensus.cc:2258] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:18:20.181214 10112 raft_consensus.cc:2229] T d09f03f64b4a44f9a31a144cb9499144 P 54153ec8728947cda3cf17b08832cb55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:18:20.181519 10109 tablet_replica.cc:330] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: stopping tablet replica
I20260807 06:18:20.181602 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9526
I20260807 06:18:20.191725 10109 raft_consensus.cc:2229] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:18:20.192385 10109 raft_consensus.cc:2258] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:18:20.194856 10111 ts_tablet_manager.cc:1905] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:18:20.198393 10111 ts_tablet_manager.cc:1918] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:18:20.198570 10111 log.cc:1196] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/d09f03f64b4a44f9a31a144cb9499144
I20260807 06:18:20.199005 10111 ts_tablet_manager.cc:1939] T d09f03f64b4a44f9a31a144cb9499144 P 934cb563bbf44978b7cce7470400ca00: Deleting consensus metadata
I20260807 06:18:20.200774 9416 catalog_manager.cc:4841] TS 934cb563bbf44978b7cce7470400ca00 (127.26.252.67:40135): tablet d09f03f64b4a44f9a31a144cb9499144 (table test-table [id=d1678ca2bc0647bfbbf56bf5cf6e5db8]) successfully deleted
I20260807 06:18:20.207806 10109 ts_tablet_manager.cc:1905] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:18:20.210839 9416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:35499 (error 108)
I20260807 06:18:20.210867 10109 ts_tablet_manager.cc:1918] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:18:20.210978 10109 log.cc:1196] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/d09f03f64b4a44f9a31a144cb9499144
I20260807 06:18:20.211319 10109 ts_tablet_manager.cc:1939] T d09f03f64b4a44f9a31a144cb9499144 P 62620928727d497d82e732775609381f: Deleting consensus metadata
I20260807 06:18:20.212535 9416 catalog_manager.cc:4841] TS 62620928727d497d82e732775609381f (127.26.252.66:34407): tablet d09f03f64b4a44f9a31a144cb9499144 (table test-table [id=d1678ca2bc0647bfbbf56bf5cf6e5db8]) successfully deleted
I20260807 06:18:20.213362 10075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:18:20.213039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35499 (local address 127.0.0.1:39310)
0807 06:18:20.213201 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 06:18:20.213277 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260807 06:18:20.213565 9416 catalog_manager.cc:4584] TS 54153ec8728947cda3cf17b08832cb55 (127.26.252.65:35499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d09f03f64b4a44f9a31a144cb9499144: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35499: connect: Connection refused (error 111)
I20260807 06:18:20.213877 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9706
I20260807 06:18:20.227212 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9887
I20260807 06:18:20.240929 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 9394
2026-08-07T06:18:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2609 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:18:20 dist-test-slave-68xk krb5kdc[10118](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:18:20 dist-test-slave-68xk krb5kdc[10118](info): set up 2 sockets
Aug 07 06:18:20 dist-test-slave-68xk krb5kdc[10118](info): commencing operation
krb5kdc: starting...
W20260807 06:18:21.514864 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:18:21 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:18:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:18:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangeradmin_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangeradmin_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangerlookup_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangerlookup_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
I20260807 06:18:21.706465 27633 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskC7DYJg/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/postgres -l logfile start
2026-08-07 06:18:24.539 UTC [10157] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:18:24.539 UTC [10157] LOG: listening on IPv4 address "127.26.252.84", port 42171
2026-08-07 06:18:24.544 UTC [10157] LOG: listening on Unix socket "/tmp/.s.PGSQL.42171"
2026-08-07 06:18:24.568 UTC [10161] LOG: database system was shut down at 2026-08-07 06:18:22 UTC
2026-08-07 06:18:24.572 UTC [10157] LOG: database system is ready to accept connections
I20260807 06:18:25.737885 27633 mini_postgres.cc:96] Postgres bound to 42171
2026-08-07 06:18:25.746 UTC [10171] FATAL: database "slave" does not exist
127.26.252.84:42171 - accepting connections
I20260807 06:18:25.747902 27633 mini_ranger.cc:161] Starting Ranger...
I20260807 06:18:25.764539 27633 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:18:26.309667 27633 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:18:26.309760 27633 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin
2026-08-07 06:18:26,658 [I] DB FLAVOR :POSTGRES
2026-08-07 06:18:26,659 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:18:26,659 [I] Checking connection..
2026-08-07 06:18:26,659 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:18:26,921 [I] Checking connection passed.
2026-08-07 06:18:26,921 [I] --------- Verifying version history table ---------
2026-08-07 06:18:26,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:18:27,189 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:18:27,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:18:27,442 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:18:27,443 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:18:27,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:18:27.705 UTC [10256] WARNING: there is no transaction in progress
2026-08-07 06:18:27,714 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:18:27,715 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:18:27,989 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:18:27,989 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:18:27,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:18:28,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:18:28,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-07 06:18:28,749 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:18:28,988 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:18:28,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:18:29,259 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:18:29,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:18:29,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:18:29,784 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:18:29,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:18:30.862 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:30.881 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:30.899 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:30.921 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:30.943 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:30.971 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.058 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.065 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.083 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.094 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.106 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.120 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.130 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.137 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.146 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31.153 UTC [10408] WARNING: there is no transaction in progress
2026-08-07 06:18:31,872 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:18:31,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:18:32,135 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:18:32,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:18:32,374 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:18:32,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:18:32,617 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:18:32,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:18:32,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:18:33,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-07 06:18:33,365 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:18:33,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:18:33,628 [I] DB_PATCHES have already been applied
I20260807 06:18:33.634703 27633 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskC7DYJg/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:18:33.634791 27633 mini_ranger.cc:193] Using host: 127.26.252.84
I20260807 06:18:33.639336 27633 mini_ranger.cc:227] Ranger admin URL: http://127.26.252.84:38167
Aug 07, 2026 6:18:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:18:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:18:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:18:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:18:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:18:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:18:34 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:18:34.983014 27633 mini_ranger.cc:160] Time spent starting Ranger: real 9.235s user 0.006s sys 0.007s
Aug 07, 2026 6:18:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:18:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 6:18:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:18:56 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:18:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:18:57.503379 27633 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangerkms_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/rangerkms_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.252.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.252.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:18:57 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083537, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:18:57.596200 27633 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:18:57.607671 27633 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:18:58.553510 27633 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:18:58.553613 27633 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms
I20260807 06:18:58.553738 27633 mini_ranger_kms.cc:227] Using postgres at 127.26.252.84:42171
2026-08-07 06:18:58,869 [I] DB FLAVOR :POSTGRES
2026-08-07 06:18:58,870 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:18:58,870 [I] Checking connection
2026-08-07 06:18:58,870 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:18:59,126 [I] connection success
2026-08-07 06:18:59,126 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:18:59,127 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:18:59,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:18:59,412 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:18:59,413 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:18:59,413 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:18:59,413 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:42171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:18:59,698 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:19:00.231243 27633 mini_ranger_kms.cc:310] Created kms service
I20260807 06:19:00.431016 27633 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:19:00.481127 27633 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:19:00 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083537, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:00.951124 27633 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:19:00.951519 27633 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms:/tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:19:00.951560 27633 mini_ranger_kms.cc:240] Using host: 127.26.252.84
I20260807 06:19:00.956789 27633 mini_ranger_kms.cc:276] Ranger KMS PID: 10670
I20260807 06:19:00.956954 27633 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.252.84:39991
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:19:02 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:19:03 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786083543, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:03.719214 27633 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.123s user 0.011s sys 0.286s
I20260807 06:19:03.719367 27633 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:19:03.719501 27633 mini_ranger_kms.cc:401] 127.26.252.84:39991/kms/v1/keys
Aug 07 06:19:04 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083543, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
Aug 07 06:19:04 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083543, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
Aug 07 06:19:06 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:19:06.681432 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44149
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44149
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:39991/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:06.796129 10731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:06.796386 10731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:06.796425 10731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:06.800700 10731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:19:06.800765 10731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:06.800784 10731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:06.800800 10731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:19:06.800815 10731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:19:06.806339 10731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.252.84:39991/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44149
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:06.807494 10731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:06.808559 10731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:06.817937 10739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:06.817950 10738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:06.817956 10731 server_base.cc:1034] running on GCE node
W20260807 06:19:06.818166 10741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:06.818908 10731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:06.820055 10731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:06.821290 10731 hybrid_clock.cc:648] HybridClock initialized: now 1786083546821274 us; error 47 us; skew 500 ppm
Aug 07 06:19:06 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083546, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:06.828348 10731 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:19:06.829571 10731 webserver.cc:460] Webserver started at http://127.26.252.126:39189/ using document root <none> and password file <none>
I20260807 06:19:06.830327 10731 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:06.830436 10731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:06.830695 10731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:06 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083546, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:06.894524 10731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8"
format_stamp: "Formatted at 2026-08-07 06:19:06 on dist-test-slave-68xk"
server_key: "16f2df2aa348786ee69fe892098448a7"
server_key_iv: "1b05b4831ed1e370d05a1464b57b71e0"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:06.895249 10731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8"
format_stamp: "Formatted at 2026-08-07 06:19:06 on dist-test-slave-68xk"
server_key: "16f2df2aa348786ee69fe892098448a7"
server_key_iv: "1b05b4831ed1e370d05a1464b57b71e0"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:06.900221 10731 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 06:19:06.918394 10749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:06.920008 10731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:19:06.920135 10731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8"
format_stamp: "Formatted at 2026-08-07 06:19:06 on dist-test-slave-68xk"
server_key: "16f2df2aa348786ee69fe892098448a7"
server_key_iv: "1b05b4831ed1e370d05a1464b57b71e0"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:06.920317 10731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:06.937424 10731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:06.940435 10731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:06.940649 10731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:06.948926 10731 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44149
I20260807 06:19:06.948951 10822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44149 every 8 connection(s)
I20260807 06:19:06.950126 10731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:19:06.953053 10823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:19:06.958673 10823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: Bootstrap starting.
I20260807 06:19:06.960078 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 10731
I20260807 06:19:06.960201 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:19:06.960497 27633 external_mini_cluster.cc:1428] Setting key 3cd8f50089625244ccb5c2b823ae628d
I20260807 06:19:06.961591 10823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: Neither blocks nor log segments found. Creating new log.
I20260807 06:19:06.962548 10823 log.cc:824] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:06.964767 10823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: No bootstrap required, opened a new log
I20260807 06:19:06.968783 10823 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } }
I20260807 06:19:06.969079 10823 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:19:06.969179 10823 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecdbdeb667da4c3dbb85179a9e0be4a8, State: Initialized, Role: FOLLOWER
I20260807 06:19:06.969722 10823 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } }
I20260807 06:19:06.969903 10823 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:19:06.970032 10823 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:19:06.970170 10823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:19:06 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:06.971179 10823 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } }
I20260807 06:19:06.971550 10823 leader_election.cc:302] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecdbdeb667da4c3dbb85179a9e0be4a8; no voters:
I20260807 06:19:06.971902 10823 leader_election.cc:288] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:19:06.972013 10834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:19:06.972229 10834 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [term 1 LEADER]: Becoming Leader. State: Replica: ecdbdeb667da4c3dbb85179a9e0be4a8, State: Running, Role: LEADER
I20260807 06:19:06.972549 10834 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } }
I20260807 06:19:06.973263 10823 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:19:06.973784 10834 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } } }
I20260807 06:19:06.973969 10834 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:06.974215 10834 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecdbdeb667da4c3dbb85179a9e0be4a8. Latest consensus state: current_term: 1 leader_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecdbdeb667da4c3dbb85179a9e0be4a8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44149 } } }
I20260807 06:19:06.974349 10834 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:06.975441 10844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:19:06.976208 10823 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:19:06.977902 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:06.961760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49694 (local address 127.26.252.126:44149)
0807 06:19:06.962278 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:06.962298 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:06.962342 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:19:06.963207 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:06.963231 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:06.963648 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:06.964015 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:06.965000 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:06.966522 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:06.967778 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:06.968531 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:06.968753 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:06.971961 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:06.971967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:06.972025 (+ 58us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:06.972056 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:06.974372 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:06.974954 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:06.974960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:06.974966 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:06.975109 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:06.975414 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:06.975417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:06.975419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:06.975945 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:06.976128 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:06.976515 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 06:19:06.976960 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":160,"threads_started":1}
I20260807 06:19:06.979738 10844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:19:06.992378 10844 catalog_manager.cc:1347] Generated new cluster ID: 2cafe4304f0c406d9ff58aebc90873cb
I20260807 06:19:06.992473 10844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:19:07.019567 10844 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:19:07.021098 10844 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:19:07.031862 10844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: Generated new TSK 0
I20260807 06:19:07.032756 10844 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:19:07.766006 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:39991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:07.931432 10884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:07.931699 10884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:07.931746 10884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:07.936272 10884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:07.936331 10884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:07.936388 10884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:19:07.942731 10884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.252.84:39991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:07.944060 10884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:07.945583 10884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:07.957703 10893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:07.957849 10896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:07.957705 10892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:07.958798 10884 server_base.cc:1034] running on GCE node
I20260807 06:19:07.959240 10884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:07.959895 10884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:07.961088 10884 hybrid_clock.cc:648] HybridClock initialized: now 1786083547961060 us; error 56 us; skew 500 ppm
Aug 07 06:19:07 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:07.964524 10884 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:19:07.965628 10884 webserver.cc:460] Webserver started at http://127.26.252.65:39479/ using document root <none> and password file <none>
I20260807 06:19:07.966382 10884 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:07.966552 10884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:07.966854 10884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:07 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:07.982151 10884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf"
format_stamp: "Formatted at 2026-08-07 06:19:07 on dist-test-slave-68xk"
server_key: "6f14cd71f66d3750d6e87e04f59f7418"
server_key_iv: "dce8d1745dca8eb992e3fa0bcb6bfb4e"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:07.983016 10884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf"
format_stamp: "Formatted at 2026-08-07 06:19:07 on dist-test-slave-68xk"
server_key: "6f14cd71f66d3750d6e87e04f59f7418"
server_key_iv: "dce8d1745dca8eb992e3fa0bcb6bfb4e"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:07.991969 10884 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.000s
I20260807 06:19:08.014215 10904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.016074 10884 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260807 06:19:08.016214 10884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf"
format_stamp: "Formatted at 2026-08-07 06:19:07 on dist-test-slave-68xk"
server_key: "6f14cd71f66d3750d6e87e04f59f7418"
server_key_iv: "dce8d1745dca8eb992e3fa0bcb6bfb4e"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.016352 10884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:08.049068 10884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:08.052990 10884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:08.053256 10884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:08.054073 10884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:08.055284 10884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:08.055415 10884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.055567 10884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:08.055621 10884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.068521 10884 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:44943
I20260807 06:19:08.068614 11050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:44943 every 8 connection(s)
I20260807 06:19:08.069842 10884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:19:08.077581 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 10884
I20260807 06:19:08.077728 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:19:08.078050 27633 external_mini_cluster.cc:1428] Setting key 453ee75bdc471d7afcc2542edfb55e32
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083547, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:08.090867 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.074297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:50167 (local address 127.26.252.126:44149)
0807 06:19:08.075729 (+ 1432us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.075734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.075755 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:19:08.076604 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.076608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.076678 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.076766 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:08.079488 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.080170 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.081432 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.081710 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.081833 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.085328 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:08.085336 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:08.085342 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:08.085379 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:08.087790 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.088601 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.088609 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.088612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.088731 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.089221 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.089227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.089229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.089491 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:08.089592 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.090402 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.090582 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1349,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:19:08.092955 11055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.073054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44149 (local address 127.26.252.65:50167)
0807 06:19:08.074827 (+ 1773us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.074890 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.076246 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.077425 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.077435 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.077824 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:08.078559 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.078581 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.080315 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.080319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.081287 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.081297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.081875 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.081881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.082146 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.082957 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:08.082985 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:08.085108 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:08.087971 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.087980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.088000 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.088436 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.088867 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.088871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.088874 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.089081 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.089688 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:08.089697 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:08.090068 (+ 371us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.091425 (+ 1357us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.091820 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1507,"thread_start_us":157,"threads_started":1}
I20260807 06:19:08.094564 11052 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44149
I20260807 06:19:08.094853 11052 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:19:08.095566 11052 heartbeater.cc:511] Master 127.26.252.126:44149 requested a full tablet report, sending...
I20260807 06:19:08.097477 10762 ts_manager.cc:194] Registered new tserver with Master: a9201dd5cb2c4bb2bbba1a3efb6cdfdf (127.26.252.65:44943)
I20260807 06:19:08.099255 10762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:50167
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:19:08.114403 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:39991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 06:19:08.247001 11060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:08.247284 11060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:08.247429 11060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:08.251845 11060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:08.251937 11060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:08.252039 11060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:19:08.257344 11060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.252.84:39991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:08.258533 11060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:08.259793 11060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:08.270998 11072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:08.270998 11070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:08.271288 11060 server_base.cc:1034] running on GCE node
W20260807 06:19:08.271128 11074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:08.271938 11060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:08.272729 11060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:08.273937 11060 hybrid_clock.cc:648] HybridClock initialized: now 1786083548273903 us; error 41 us; skew 500 ppm
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:08.277792 11060 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:19:08.278913 11060 webserver.cc:460] Webserver started at http://127.26.252.66:35985/ using document root <none> and password file <none>
I20260807 06:19:08.279610 11060 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:08.279699 11060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:08.279928 11060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:08.296802 11060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "3a8d20dedf354868a6bddff4e3c063b8"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "c3bf4afd1bc4a77bfe3bf1fb1a6665e3"
server_key_iv: "29efd06d5ba5a25f51686640ec722b17"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.297686 11060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "3a8d20dedf354868a6bddff4e3c063b8"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "c3bf4afd1bc4a77bfe3bf1fb1a6665e3"
server_key_iv: "29efd06d5ba5a25f51686640ec722b17"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.303233 11060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:19:08.325109 11085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.326983 11060 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:19:08.327183 11060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "3a8d20dedf354868a6bddff4e3c063b8"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "c3bf4afd1bc4a77bfe3bf1fb1a6665e3"
server_key_iv: "29efd06d5ba5a25f51686640ec722b17"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.327364 11060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:08.357610 11060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:08.361459 11060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:08.361742 11060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:08.362620 11060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:08.363855 11060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:08.363955 11060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.364046 11060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:08.364099 11060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.375916 11060 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:43807
I20260807 06:19:08.377166 11060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:19:08.377823 11237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:43807 every 8 connection(s)
I20260807 06:19:08.383961 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 11060
I20260807 06:19:08.384097 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:19:08.384426 27633 external_mini_cluster.cc:1428] Setting key e99560d731ee8d51d411dbd1304c4fc9
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:08.406513 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.382042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:35983 (local address 127.26.252.126:44149)
0807 06:19:08.382199 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.382221 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.390996 (+ 8775us) server_negotiation.cc:407] Connection header received
0807 06:19:08.392322 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.392326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.392378 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.392472 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:08.394098 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.394991 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.396786 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.397145 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.397236 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.401875 (+ 4639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:08.401879 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:08.401895 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:08.401925 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:08.403797 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.404457 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.404461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.404463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.404559 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.405036 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.405040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.405041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.405290 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:08.405376 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.406143 (+ 767us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.406295 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:19:08.408438 11241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.380924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44149 (local address 127.26.252.66:35983)
0807 06:19:08.390814 (+ 9890us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.390887 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.392067 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.392820 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.392829 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.393220 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:08.393907 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.393932 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.395162 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.395166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.396620 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.396631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.397455 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.397459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.397672 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.399767 (+ 2095us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:08.399791 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:08.401659 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:08.403952 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.403958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.403974 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.404329 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.404707 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.404710 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.404712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.404911 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.405469 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:08.405476 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:08.405826 (+ 350us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.407009 (+ 1183us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.407356 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9616,"thread_start_us":139,"threads_started":1}
I20260807 06:19:08.410071 11238 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44149
I20260807 06:19:08.410326 11238 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:08.410953 11238 heartbeater.cc:511] Master 127.26.252.126:44149 requested a full tablet report, sending...
I20260807 06:19:08.412155 10762 ts_manager.cc:194] Registered new tserver with Master: 3a8d20dedf354868a6bddff4e3c063b8 (127.26.252.66:43807)
I20260807 06:19:08.412923 10762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:35983
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:19:08.447412 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:39991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:08.600973 11244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:08.601856 11244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:08.602020 11244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:08.608385 11244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:08.608596 11244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:08.608772 11244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:19:08.616766 11244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.252.84:39991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:08.618510 11244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:08.619951 11244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:08.635181 11249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:08.636461 11244 server_base.cc:1034] running on GCE node
W20260807 06:19:08.636775 11251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:08.637090 11253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:08.637703 11244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:08.638550 11244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:08.639796 11244 hybrid_clock.cc:648] HybridClock initialized: now 1786083548639726 us; error 86 us; skew 500 ppm
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:08.643741 11244 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:19:08.644898 11244 webserver.cc:460] Webserver started at http://127.26.252.67:38927/ using document root <none> and password file <none>
I20260807 06:19:08.645704 11244 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:08.645861 11244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:08.646178 11244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:08.666489 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "2f3ffc0e3f60441883f638f21a574c19"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "6f155bac8a83161a7fd2beebd52b8dea"
server_key_iv: "63254d5c1e18e1b8f1d9298b5a2a5811"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.669094 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "2f3ffc0e3f60441883f638f21a574c19"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "6f155bac8a83161a7fd2beebd52b8dea"
server_key_iv: "63254d5c1e18e1b8f1d9298b5a2a5811"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.675060 11244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:19:08.710857 11262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.715804 11244 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.002s sys 0.000s
I20260807 06:19:08.716070 11244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "2f3ffc0e3f60441883f638f21a574c19"
format_stamp: "Formatted at 2026-08-07 06:19:08 on dist-test-slave-68xk"
server_key: "6f155bac8a83161a7fd2beebd52b8dea"
server_key_iv: "63254d5c1e18e1b8f1d9298b5a2a5811"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:08.716328 11244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:08.788748 11244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:08.792371 11244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:08.792630 11244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:08.793385 11244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:08.794438 11244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:08.794538 11244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.794631 11244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:08.794689 11244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:08.805222 11244 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:32811
I20260807 06:19:08.806638 11244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:19:08.815526 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 11244
I20260807 06:19:08.815657 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:19:08.815954 27633 external_mini_cluster.cc:1428] Setting key 453f7186a0a93c3055f894c1ff01a7c0
I20260807 06:19:08.831514 11425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:32811 every 8 connection(s)
Aug 07 06:19:08 dist-test-slave-68xk krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083548, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:08.862984 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.835690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:47881 (local address 127.26.252.126:44149)
0807 06:19:08.835818 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.835823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.841075 (+ 5252us) server_negotiation.cc:407] Connection header received
0807 06:19:08.843735 (+ 2660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.843739 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.843799 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.843857 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:08.850539 (+ 6682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.851375 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.853153 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.853484 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.853566 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.858542 (+ 4976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:08.858546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:08.858549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:08.858578 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:08.860370 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.861032 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.861036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.861037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.861133 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.861601 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.861605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.861606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.861841 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:08.861928 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.862686 (+ 758us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.862817 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:19:08.864935 11428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.834499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44149 (local address 127.26.252.67:47881)
0807 06:19:08.840889 (+ 6390us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.840963 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.842162 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.844355 (+ 2193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.844366 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.844946 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:08.845697 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.845717 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.851564 (+ 5847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.851568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.852989 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.853002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.853783 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.853787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.853992 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.854817 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:08.854839 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:08.856617 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:08.860522 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.860528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.860547 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.860903 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.861275 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:08.861278 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:08.861280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:08.861477 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:08.861999 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:08.862005 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:08.862351 (+ 346us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.863490 (+ 1139us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.863857 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6118,"thread_start_us":181,"threads_started":1}
I20260807 06:19:08.876224 11426 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44149
I20260807 06:19:08.876531 11426 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:08.877169 11426 heartbeater.cc:511] Master 127.26.252.126:44149 requested a full tablet report, sending...
I20260807 06:19:08.878463 10762 ts_manager.cc:194] Registered new tserver with Master: 2f3ffc0e3f60441883f638f21a574c19 (127.26.252.67:32811)
I20260807 06:19:08.879259 10762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:47881
I20260807 06:19:08.888648 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:19:08.912376 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.897337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.26.252.126:44149)
0807 06:19:08.897469 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.897474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.902820 (+ 5346us) server_negotiation.cc:407] Connection header received
0807 06:19:08.903037 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.903041 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.903095 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.903150 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:08.904228 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.905016 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.906201 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.906551 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.906630 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.908551 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:08.908555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:08.908557 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:08.908586 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:08.910337 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.910892 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.910896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.910898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.910990 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:08.911329 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:08.911332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:08.911334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:08.911567 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:08.911680 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.912085 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.912210 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:19:08.916361 10762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:19:08.921062 10762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:19:08.939473 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.932053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:32811 (local address 127.0.0.1:33844)
0807 06:19:08.933660 (+ 1607us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.933674 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.933756 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.934547 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.934553 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.934579 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:19:08.934729 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.934737 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.936204 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.936208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.937532 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.937544 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.938927 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.938930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.939038 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.939077 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.939187 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.939305 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1541,"thread_start_us":106,"threads_started":1}
I20260807 06:19:08.940116 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.932241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33844 (local address 127.26.252.67:32811)
0807 06:19:08.933992 (+ 1751us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.934004 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.934028 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:19:08.934106 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.934111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.934318 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.934504 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:19:08.934889 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.936067 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.937713 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.938584 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.938693 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.938858 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.939863 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.939969 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1650,"thread_start_us":114,"threads_started":1}
I20260807 06:19:08.940165 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.933329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53556 (local address 127.26.252.65:44943)
0807 06:19:08.933625 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.933632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.934955 (+ 1323us) server_negotiation.cc:407] Connection header received
0807 06:19:08.935038 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.935043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.935227 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.935355 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:19:08.935745 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.936857 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.938275 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.939085 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.939192 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.939324 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.939926 (+ 602us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.940030 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
I20260807 06:19:08.939816 11446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.933148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:44943 (local address 127.0.0.1:53556)
0807 06:19:08.934757 (+ 1609us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.934770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.934860 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.935489 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.935492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.935509 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:19:08.935614 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.935620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.936994 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.936998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.938105 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.938116 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.939389 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.939393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.939498 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.939521 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.939606 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.939675 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1546,"thread_start_us":86,"threads_started":1}
I20260807 06:19:08.944110 11313 tablet_service.cc:1467] Processing CreateTablet for tablet a47f41524ffc4341a8e32461aa903571 (DEFAULT_TABLE table=test-table [id=62e905c9d97e4f0e8ef4fdd20b00d52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:19:08.944146 10968 tablet_service.cc:1467] Processing CreateTablet for tablet a47f41524ffc4341a8e32461aa903571 (DEFAULT_TABLE table=test-table [id=62e905c9d97e4f0e8ef4fdd20b00d52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:19:08.945384 10968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f41524ffc4341a8e32461aa903571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:19:08.945533 11313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f41524ffc4341a8e32461aa903571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:19:08.946619 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.932012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:43807 (local address 127.0.0.1:55670)
0807 06:19:08.933216 (+ 1204us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:08.933271 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:08.933405 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:08.942141 (+ 8736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:08.942144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:08.942166 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:19:08.942253 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.942259 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.943789 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.943792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.944887 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:08.944899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.946046 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.946050 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:08.946141 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.946169 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:19:08.946222 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:19:08.946468 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":109,"threads_started":1}
I20260807 06:19:08.947394 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:08.932180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55670 (local address 127.26.252.66:43807)
0807 06:19:08.940627 (+ 8447us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:08.940634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:08.940660 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:19:08.940737 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:08.940742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:08.940944 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:08.942443 (+ 1499us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:19:08.942605 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.943645 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.945077 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:08.945895 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:08.946950 (+ 1055us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:08.947099 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:08.947158 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 06:19:08.947256 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8309,"thread_start_us":78,"threads_started":1}
I20260807 06:19:08.957690 11149 tablet_service.cc:1467] Processing CreateTablet for tablet a47f41524ffc4341a8e32461aa903571 (DEFAULT_TABLE table=test-table [id=62e905c9d97e4f0e8ef4fdd20b00d52a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:19:08.958854 11149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f41524ffc4341a8e32461aa903571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:19:08.965204 11452 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Bootstrap starting.
I20260807 06:19:08.967696 11452 tablet_bootstrap.cc:654] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Neither blocks nor log segments found. Creating new log.
I20260807 06:19:08.968822 11452 log.cc:824] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:08.969985 11453 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Bootstrap starting.
I20260807 06:19:08.971184 11452 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: No bootstrap required, opened a new log
I20260807 06:19:08.972330 11452 ts_tablet_manager.cc:1397] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260807 06:19:08.972388 11453 tablet_bootstrap.cc:654] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Neither blocks nor log segments found. Creating new log.
I20260807 06:19:08.973446 11453 log.cc:824] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:08.975649 11453 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: No bootstrap required, opened a new log
I20260807 06:19:08.975828 11453 ts_tablet_manager.cc:1397] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 06:19:08.978005 11452 raft_consensus.cc:348] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:08.978276 11452 raft_consensus.cc:374] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:19:08.978331 11452 raft_consensus.cc:729] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9201dd5cb2c4bb2bbba1a3efb6cdfdf, State: Initialized, Role: FOLLOWER
I20260807 06:19:08.978854 11452 consensus_queue.cc:260] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:08.979964 11452 ts_tablet_manager.cc:1428] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260807 06:19:08.980099 11453 raft_consensus.cc:348] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:08.980317 11052 heartbeater.cc:503] Master 127.26.252.126:44149 was elected leader, sending a full tablet report...
I20260807 06:19:08.980337 11453 raft_consensus.cc:374] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:19:08.980382 11453 raft_consensus.cc:729] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a8d20dedf354868a6bddff4e3c063b8, State: Initialized, Role: FOLLOWER
I20260807 06:19:08.981103 11453 consensus_queue.cc:260] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:08.984639 11450 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Bootstrap starting.
I20260807 06:19:08.986778 11453 ts_tablet_manager.cc:1428] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Time spent starting tablet: real 0.011s user 0.004s sys 0.002s
I20260807 06:19:08.987200 11238 heartbeater.cc:503] Master 127.26.252.126:44149 was elected leader, sending a full tablet report...
I20260807 06:19:08.987838 11450 tablet_bootstrap.cc:654] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Neither blocks nor log segments found. Creating new log.
I20260807 06:19:08.988776 11450 log.cc:824] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:08.992964 11450 tablet_bootstrap.cc:492] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: No bootstrap required, opened a new log
I20260807 06:19:08.993242 11450 ts_tablet_manager.cc:1397] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 06:19:08.998241 11450 raft_consensus.cc:348] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:08.998634 11450 raft_consensus.cc:374] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:19:08.998742 11450 raft_consensus.cc:729] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3ffc0e3f60441883f638f21a574c19, State: Initialized, Role: FOLLOWER
I20260807 06:19:08.999306 11450 consensus_queue.cc:260] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:09.000337 11450 ts_tablet_manager.cc:1428] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:19:09.000733 11426 heartbeater.cc:503] Master 127.26.252.126:44149 was elected leader, sending a full tablet report...
I20260807 06:19:09.053300 11457 raft_consensus.cc:482] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:19:09.053586 11457 raft_consensus.cc:504] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:09.055016 11457 leader_election.cc:288] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a8d20dedf354868a6bddff4e3c063b8 (127.26.252.66:43807), 2f3ffc0e3f60441883f638f21a574c19 (127.26.252.67:32811)
I20260807 06:19:09.061043 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.055644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:41969 (local address 127.26.252.66:43807)
0807 06:19:09.055995 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:09.056000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:09.056018 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:19:09.056177 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:09.056181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:09.056240 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:09.056298 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:19:09.056857 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.057714 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.059530 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.060236 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.060335 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:09.060393 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:09.060791 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 06:19:09.060898 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260807 06:19:09.061129 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.056167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:53829 (local address 127.26.252.67:32811)
0807 06:19:09.056314 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:09.056320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:09.056643 (+ 323us) server_negotiation.cc:407] Connection header received
0807 06:19:09.056848 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:09.056851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:09.056905 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:09.056957 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:19:09.057373 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.058149 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.059798 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.060416 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.060515 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:09.060579 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:09.060928 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:19:09.061004 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:19:09.061558 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.055249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:43807 (local address 127.26.252.65:41969)
0807 06:19:09.055868 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:09.055887 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:09.056009 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:09.056512 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:09.056515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:09.056536 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:19:09.056716 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:09.056722 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.057862 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.057865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:09.059380 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:09.059392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.060517 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.060521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:09.060633 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:09.060661 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:19:09.061287 (+ 626us) client_negotiation.cc:240] Negotiation successful
0807 06:19:09.061389 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"mutex_wait_us":31,"thread_start_us":142,"threads_started":1}
I20260807 06:19:09.061968 11465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.055540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:32811 (local address 127.26.252.65:53829)
0807 06:19:09.056538 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:09.056565 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:09.056710 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:09.057098 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:09.057101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:09.057119 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:19:09.057242 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:09.057248 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.058320 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.058324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:09.059654 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:09.059664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.060675 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.060678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:09.060788 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:09.060810 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:19:09.061604 (+ 794us) client_negotiation.cc:240] Negotiation successful
0807 06:19:09.061777 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":14,"thread_start_us":123,"threads_started":1}
I20260807 06:19:09.062326 11176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f41524ffc4341a8e32461aa903571" candidate_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a8d20dedf354868a6bddff4e3c063b8" is_pre_election: true
I20260807 06:19:09.062732 11176 raft_consensus.cc:2454] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9201dd5cb2c4bb2bbba1a3efb6cdfdf in term 0.
I20260807 06:19:09.062867 11354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f41524ffc4341a8e32461aa903571" candidate_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3ffc0e3f60441883f638f21a574c19" is_pre_election: true
I20260807 06:19:09.063177 11354 raft_consensus.cc:2454] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9201dd5cb2c4bb2bbba1a3efb6cdfdf in term 0.
I20260807 06:19:09.063293 10908 leader_election.cc:302] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a8d20dedf354868a6bddff4e3c063b8, a9201dd5cb2c4bb2bbba1a3efb6cdfdf; no voters:
I20260807 06:19:09.063604 11457 raft_consensus.cc:2781] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:19:09.063687 11457 raft_consensus.cc:482] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:19:09.063750 11457 raft_consensus.cc:3037] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:19:09.065235 11457 raft_consensus.cc:504] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:09.065594 11457 leader_election.cc:288] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [CANDIDATE]: Term 1 election: Requested vote from peers 3a8d20dedf354868a6bddff4e3c063b8 (127.26.252.66:43807), 2f3ffc0e3f60441883f638f21a574c19 (127.26.252.67:32811)
I20260807 06:19:09.066001 11176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f41524ffc4341a8e32461aa903571" candidate_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a8d20dedf354868a6bddff4e3c063b8"
I20260807 06:19:09.066129 11176 raft_consensus.cc:3037] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:19:09.066267 11354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f41524ffc4341a8e32461aa903571" candidate_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f3ffc0e3f60441883f638f21a574c19"
I20260807 06:19:09.066397 11354 raft_consensus.cc:3037] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:19:09.067581 11176 raft_consensus.cc:2454] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9201dd5cb2c4bb2bbba1a3efb6cdfdf in term 1.
I20260807 06:19:09.067963 11354 raft_consensus.cc:2454] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9201dd5cb2c4bb2bbba1a3efb6cdfdf in term 1.
I20260807 06:19:09.068369 10908 leader_election.cc:302] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a8d20dedf354868a6bddff4e3c063b8, a9201dd5cb2c4bb2bbba1a3efb6cdfdf; no voters:
I20260807 06:19:09.068647 11457 raft_consensus.cc:2781] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:19:09.068867 11457 raft_consensus.cc:686] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [term 1 LEADER]: Becoming Leader. State: Replica: a9201dd5cb2c4bb2bbba1a3efb6cdfdf, State: Running, Role: LEADER
I20260807 06:19:09.069203 11457 consensus_queue.cc:237] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } }
I20260807 06:19:09.072731 10771 catalog_manager.cc:5495] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf reported cstate change: term changed from 0 to 1, leader changed from <none> to a9201dd5cb2c4bb2bbba1a3efb6cdfdf (127.26.252.65). New cstate: current_term: 1 leader_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9201dd5cb2c4bb2bbba1a3efb6cdfdf" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 44943 } health_report { overall_health: HEALTHY } } }
W20260807 06:19:09.077936 11053 tablet.cc:2369] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:19:09.082552 11427 tablet.cc:2369] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:19:09.085932 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.080851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53566 (local address 127.26.252.65:44943)
0807 06:19:09.081005 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:09.081009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:09.081042 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:19:09.081225 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:09.081229 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:09.081292 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:09.081398 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:19:09.081813 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.082712 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.084140 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:09.084498 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:09.084616 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:09.084980 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:19:09.085494 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:19:09.085618 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:09.085742 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 06:19:09.085803 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:19:09.093459 11354 raft_consensus.cc:1261] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 1 FOLLOWER]: Refusing update from remote peer a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:19:09.093778 11176 raft_consensus.cc:1261] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 1 FOLLOWER]: Refusing update from remote peer a9201dd5cb2c4bb2bbba1a3efb6cdfdf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:19:09.094317 11466 consensus_queue.cc:1035] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f3ffc0e3f60441883f638f21a574c19" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 32811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:19:09.094517 11457 consensus_queue.cc:1035] T a47f41524ffc4341a8e32461aa903571 P a9201dd5cb2c4bb2bbba1a3efb6cdfdf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a8d20dedf354868a6bddff4e3c063b8" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:19:09.102438 11471 mvcc.cc:205] Tried to move back new op lower bound from 7315798217078661120 to 7315798216990515200. Current Snapshot: MvccSnapshot[applied={T|T < 7315798217078661120}]
I20260807 06:19:09.118675 11474 mvcc.cc:205] Tried to move back new op lower bound from 7315798217078661120 to 7315798216990515200. Current Snapshot: MvccSnapshot[applied={T|T < 7315798217078661120}]
I20260807 06:19:09.121328 10762 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:19:09.121536 10762 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:19:09.124691 10762 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecdbdeb667da4c3dbb85179a9e0be4a8: Sending DeleteTablet for 3 replicas of tablet a47f41524ffc4341a8e32461aa903571
I20260807 06:19:09.126122 11313 tablet_service.cc:1514] Processing DeleteTablet for tablet a47f41524ffc4341a8e32461aa903571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:19:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:33844
I20260807 06:19:09.126783 10968 tablet_service.cc:1514] Processing DeleteTablet for tablet a47f41524ffc4341a8e32461aa903571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:19:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:53556
I20260807 06:19:09.127828 11149 tablet_service.cc:1514] Processing DeleteTablet for tablet a47f41524ffc4341a8e32461aa903571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:19:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:55670
I20260807 06:19:09.129009 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 10884
I20260807 06:19:09.131724 11485 tablet_replica.cc:330] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: stopping tablet replica
I20260807 06:19:09.132140 11485 raft_consensus.cc:2229] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:19:09.132511 11485 raft_consensus.cc:2258] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:19:09.134508 11487 tablet_replica.cc:330] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: stopping tablet replica
I20260807 06:19:09.134867 11487 raft_consensus.cc:2229] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:19:09.135314 11487 raft_consensus.cc:2258] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:19:09.135955 11485 ts_tablet_manager.cc:1905] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:19:09.137373 11487 ts_tablet_manager.cc:1905] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:19:09.139091 11485 ts_tablet_manager.cc:1918] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:19:09.139266 11485 log.cc:1196] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/a47f41524ffc4341a8e32461aa903571
I20260807 06:19:09.139694 11485 ts_tablet_manager.cc:1939] T a47f41524ffc4341a8e32461aa903571 P 2f3ffc0e3f60441883f638f21a574c19: Deleting consensus metadata
I20260807 06:19:09.141124 10750 catalog_manager.cc:4841] TS 2f3ffc0e3f60441883f638f21a574c19 (127.26.252.67:32811): tablet a47f41524ffc4341a8e32461aa903571 (table test-table [id=62e905c9d97e4f0e8ef4fdd20b00d52a]) successfully deleted
I20260807 06:19:09.141351 11487 ts_tablet_manager.cc:1918] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:19:09.141469 11487 log.cc:1196] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/a47f41524ffc4341a8e32461aa903571
I20260807 06:19:09.141841 11487 ts_tablet_manager.cc:1939] T a47f41524ffc4341a8e32461aa903571 P 3a8d20dedf354868a6bddff4e3c063b8: Deleting consensus metadata
I20260807 06:19:09.143415 10754 catalog_manager.cc:4841] TS 3a8d20dedf354868a6bddff4e3c063b8 (127.26.252.66:43807): tablet a47f41524ffc4341a8e32461aa903571 (table test-table [id=62e905c9d97e4f0e8ef4fdd20b00d52a]) successfully deleted
W20260807 06:19:09.146327 10750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:44943 (error 108)
I20260807 06:19:09.146553 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 11060
I20260807 06:19:09.154181 11442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:09.153805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:44943 (local address 127.0.0.1:53572)
0807 06:19:09.154009 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:09.154084 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:44943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260807 06:19:09.154569 10750 catalog_manager.cc:4584] TS a9201dd5cb2c4bb2bbba1a3efb6cdfdf (127.26.252.65:44943): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a47f41524ffc4341a8e32461aa903571: Network error: Client connection negotiation failed: client connection to 127.26.252.65:44943: connect: Connection refused (error 111)
I20260807 06:19:09.161885 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 11244
I20260807 06:19:09.175125 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 10731
I20260807 06:19:09.187440 27633 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:19:09.532104 27633 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:19:09.532241 27633 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:19:09.887655 27633 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:19:09.887 UTC [10157] LOG: received smart shutdown request
2026-08-07 06:19:09.892 UTC [10157] LOG: background worker "logical replication launcher" (PID 10169) exited with exit code 1
2026-08-07 06:19:09.892 UTC [10163] LOG: shutting down
2026-08-07 06:19:10.091 UTC [10157] LOG: database system is shut down
2026-08-07T06:19:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49974 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:19:10 dist-test-slave-68xk krb5kdc[11503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:19:10 dist-test-slave-68xk krb5kdc[11503](info): set up 2 sockets
Aug 07 06:19:10 dist-test-slave-68xk krb5kdc[11503](info): commencing operation
krb5kdc: starting...
W20260807 06:19:11.467783 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:19:11 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:19:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:19:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangeradmin_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangeradmin_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangerlookup_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangerlookup_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
I20260807 06:19:11.649689 27633 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskC7DYJg/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/postgres -l logfile start
2026-08-07 06:19:14.316 UTC [11539] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:19:14.316 UTC [11539] LOG: listening on IPv4 address "127.26.252.84", port 43565
2026-08-07 06:19:14.320 UTC [11539] LOG: listening on Unix socket "/tmp/.s.PGSQL.43565"
2026-08-07 06:19:14.343 UTC [11546] LOG: database system was shut down at 2026-08-07 06:19:12 UTC
2026-08-07 06:19:14.347 UTC [11539] LOG: database system is ready to accept connections
I20260807 06:19:15.520069 27633 mini_postgres.cc:96] Postgres bound to 43565
2026-08-07 06:19:15.527 UTC [11558] FATAL: database "slave" does not exist
127.26.252.84:43565 - accepting connections
I20260807 06:19:15.528290 27633 mini_ranger.cc:161] Starting Ranger...
I20260807 06:19:15.544061 27633 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:19:16.061403 27633 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:19:16.061496 27633 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin
2026-08-07 06:19:16,330 [I] DB FLAVOR :POSTGRES
2026-08-07 06:19:16,331 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:19:16,331 [I] Checking connection..
2026-08-07 06:19:16,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:19:16,608 [I] Checking connection passed.
2026-08-07 06:19:16,608 [I] --------- Verifying version history table ---------
2026-08-07 06:19:16,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:19:16,896 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:19:16,896 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:19:17,181 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:19:17,182 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:19:17,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:19:17.460 UTC [11656] WARNING: there is no transaction in progress
2026-08-07 06:19:17,469 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:19:17,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:19:17,737 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:19:17,737 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:19:17,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:19:18,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:19:18,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-07 06:19:18,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:19:18,804 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:19:18,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:19:19,052 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:19:19,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:19:19,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:19:19,567 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:19:19,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:19:20.572 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.590 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.606 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.623 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.642 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.662 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.726 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.733 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.749 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.759 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.769 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.782 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.793 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.800 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.807 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:20.814 UTC [11806] WARNING: there is no transaction in progress
2026-08-07 06:19:21,509 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:19:21,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:19:21,762 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:19:21,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:19:22,051 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:19:22,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:19:22,320 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:19:22,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:19:22,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:19:22,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-07 06:19:23,061 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:19:23,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:19:23,303 [I] DB_PATCHES have already been applied
I20260807 06:19:23.310253 27633 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskC7DYJg/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:19:23.310323 27633 mini_ranger.cc:193] Using host: 127.26.252.84
I20260807 06:19:23.314927 27633 mini_ranger.cc:227] Ranger admin URL: http://127.26.252.84:57903
Aug 07, 2026 6:19:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:19:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:19:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:19:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:19:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:19:24 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:19:24.654649 27633 mini_ranger.cc:160] Time spent starting Ranger: real 9.126s user 0.003s sys 0.010s
Aug 07, 2026 6:19:45 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:19:45 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 6:19:45 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:19:45 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:19:46 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:19:47.279356 27633 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.252.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.252.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangerkms_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.252.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/rangerkms_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.252.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.252.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.252.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/HTTP_127.26.252.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:19:47 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083587, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:19:47.373620 27633 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:19:47.384639 27633 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:19:48.355453 27633 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:19:48.355544 27633 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms
I20260807 06:19:48.355566 27633 mini_ranger_kms.cc:227] Using postgres at 127.26.252.84:43565
2026-08-07 06:19:48,536 [I] DB FLAVOR :POSTGRES
2026-08-07 06:19:48,536 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:19:48,536 [I] Checking connection
2026-08-07 06:19:48,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:19:48,783 [I] connection success
2026-08-07 06:19:48,783 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:19:48,783 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:19:48,783 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:19:49,050 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:19:49,051 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:19:49,051 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:19:49,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.252.84:43565/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:19:49,313 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:19:49.848265 27633 mini_ranger_kms.cc:310] Created kms service
I20260807 06:19:50.036228 27633 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:19:50.084501 27633 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:19:50 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083587, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:50.524296 27633 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:19:50.524459 27633 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms:/tmp/dist-test-taskC7DYJg/build/debug/bin/postgresql.jar:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskC7DYJg/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:19:50.524484 27633 mini_ranger_kms.cc:240] Using host: 127.26.252.84
I20260807 06:19:50.528998 27633 mini_ranger_kms.cc:276] Ranger KMS PID: 12057
I20260807 06:19:50.529088 27633 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.252.84:40021
Aug 07, 2026 6:19:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:19:51 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:19:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:19:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:19:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:19:52 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:19:52 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786083592, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 06:19:53 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083592, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:53.297204 27633 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.924s user 0.007s sys 0.155s
I20260807 06:19:53.297336 27633 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:19:53.297405 27633 mini_ranger_kms.cc:401] 127.26.252.84:40021/kms/v1/keys
Aug 07 06:19:53 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083592, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.252.84@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
Aug 07 06:19:56 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:19:56.041715 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44037
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44037
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:56.158784 12126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:56.159045 12126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:56.159085 12126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:56.163280 12126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:19:56.163347 12126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:56.163368 12126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:56.163384 12126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:19:56.163400 12126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:19:56.169108 12126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.252.84:40021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44037
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:56.170295 12126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:56.171401 12126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:56.180792 12139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:56.180962 12126 server_base.cc:1034] running on GCE node
W20260807 06:19:56.180792 12134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:56.180787 12133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:56.181831 12126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:56.183063 12126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:56.184276 12126 hybrid_clock.cc:648] HybridClock initialized: now 1786083596184260 us; error 32 us; skew 500 ppm
Aug 07 06:19:56 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:56.193208 12126 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:19:56.194373 12126 webserver.cc:460] Webserver started at http://127.26.252.126:43551/ using document root <none> and password file <none>
I20260807 06:19:56.195016 12126 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:56.195111 12126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:56.195364 12126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:56 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:56.252038 12126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "d36f027ae7f7435d949750a13305b383"
format_stamp: "Formatted at 2026-08-07 06:19:56 on dist-test-slave-68xk"
server_key: "6c744fe8877cf07c529ae4a31039b26d"
server_key_iv: "0197ae6cfcb7674766e5c0ec87a64a07"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:56.252722 12126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "d36f027ae7f7435d949750a13305b383"
format_stamp: "Formatted at 2026-08-07 06:19:56 on dist-test-slave-68xk"
server_key: "6c744fe8877cf07c529ae4a31039b26d"
server_key_iv: "0197ae6cfcb7674766e5c0ec87a64a07"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:56.257221 12126 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:19:56.272429 12150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:56.273980 12126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:19:56.274107 12126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "d36f027ae7f7435d949750a13305b383"
format_stamp: "Formatted at 2026-08-07 06:19:56 on dist-test-slave-68xk"
server_key: "6c744fe8877cf07c529ae4a31039b26d"
server_key_iv: "0197ae6cfcb7674766e5c0ec87a64a07"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:56.274281 12126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:56.290722 12126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:56.294338 12126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:56.294950 12126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:56.303293 12126 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44037
I20260807 06:19:56.303293 12225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44037 every 8 connection(s)
I20260807 06:19:56.304345 12126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:19:56.307358 12227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:19:56.310530 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12126
I20260807 06:19:56.310686 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:19:56.311038 27633 external_mini_cluster.cc:1428] Setting key 465e65c2ad56da5678b0ce893a139847
I20260807 06:19:56.313917 12227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Bootstrap starting.
I20260807 06:19:56.316715 12227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Neither blocks nor log segments found. Creating new log.
I20260807 06:19:56.317497 12227 log.cc:824] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:56.320137 12227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: No bootstrap required, opened a new log
Aug 07 06:19:56 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:56.325464 12227 raft_consensus.cc:348] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:56.325896 12227 raft_consensus.cc:374] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:19:56.326068 12227 raft_consensus.cc:729] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36f027ae7f7435d949750a13305b383, State: Initialized, Role: FOLLOWER
I20260807 06:19:56.326720 12227 consensus_queue.cc:260] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:56.326915 12227 raft_consensus.cc:388] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:19:56.327023 12227 raft_consensus.cc:482] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:19:56.327150 12227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:19:56.327409 12230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:56.312724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.26.252.126:44037)
0807 06:19:56.313248 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:56.313268 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:56.313312 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:19:56.314140 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:56.314166 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:56.314653 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:56.315037 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:56.316201 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:56.317988 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:56.319052 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:56.319565 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:56.319753 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:56.322381 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:56.322387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:56.322401 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:56.322479 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:56.324205 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:56.324696 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:56.324702 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:56.324707 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:56.324822 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:56.325149 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:56.325154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:56.325156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:56.325571 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:56.325821 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:56.326065 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 06:19:56.326380 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":157,"threads_started":1}
I20260807 06:19:56.328451 12227 raft_consensus.cc:504] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:56.328902 12227 leader_election.cc:302] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d36f027ae7f7435d949750a13305b383; no voters:
I20260807 06:19:56.329329 12227 leader_election.cc:288] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:19:56.329432 12234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:19:56.329672 12234 raft_consensus.cc:686] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 LEADER]: Becoming Leader. State: Replica: d36f027ae7f7435d949750a13305b383, State: Running, Role: LEADER
I20260807 06:19:56.330019 12234 consensus_queue.cc:237] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:56.330817 12227 sys_catalog.cc:564] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:19:56.331396 12234 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36f027ae7f7435d949750a13305b383. Latest consensus state: current_term: 1 leader_uuid: "d36f027ae7f7435d949750a13305b383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } } }
I20260807 06:19:56.331552 12234 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:56.331849 12237 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d36f027ae7f7435d949750a13305b383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } } }
I20260807 06:19:56.331947 12237 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:56.333483 12227 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:19:56.337653 12242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:19:56.341769 12242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:19:56.349176 12242 catalog_manager.cc:1347] Generated new cluster ID: 031f35d6d546465282cd4be1099e8ef1
I20260807 06:19:56.349254 12242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:19:56.366035 12242 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:19:56.367390 12242 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:19:56.375869 12242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Generated new TSK 0
I20260807 06:19:56.376696 12242 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:19:57.078285 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:57.243791 12289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:57.244064 12289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:57.244112 12289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:57.249179 12289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:57.249279 12289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:57.249395 12289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:19:57.255560 12289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:57.256938 12289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:57.258307 12289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:57.271282 12302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:57.271834 12298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:57.271811 12297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:57.273087 12289 server_base.cc:1034] running on GCE node
I20260807 06:19:57.273540 12289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:57.274284 12289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:57.275434 12289 hybrid_clock.cc:648] HybridClock initialized: now 1786083597275368 us; error 82 us; skew 500 ppm
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:57.279054 12289 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:19:57.280074 12289 webserver.cc:460] Webserver started at http://127.26.252.65:32879/ using document root <none> and password file <none>
I20260807 06:19:57.280762 12289 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:57.280836 12289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:57.281059 12289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:57.299075 12289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "1005c20ee56a4497b281958a1ef846d7"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "5167933cde63a4fbbcb4f69eedd31a6f"
server_key_iv: "a1ebc7aafc94a7fcb8550f1b73c6e387"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.299913 12289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "1005c20ee56a4497b281958a1ef846d7"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "5167933cde63a4fbbcb4f69eedd31a6f"
server_key_iv: "a1ebc7aafc94a7fcb8550f1b73c6e387"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.315955 12289 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.004s sys 0.000s
I20260807 06:19:57.334930 12312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:57.336660 12289 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260807 06:19:57.336819 12289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "1005c20ee56a4497b281958a1ef846d7"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "5167933cde63a4fbbcb4f69eedd31a6f"
server_key_iv: "a1ebc7aafc94a7fcb8550f1b73c6e387"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.336954 12289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:57.366627 12289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:57.369870 12289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:57.370086 12289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:57.370862 12289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:57.371867 12289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:57.371938 12289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:57.372148 12289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:57.372210 12289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:57.384045 12289 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38503
I20260807 06:19:57.385015 12289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:19:57.387121 12473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38503 every 8 connection(s)
I20260807 06:19:57.392410 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12289
I20260807 06:19:57.392565 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:19:57.392903 27633 external_mini_cluster.cc:1428] Setting key 7b4db916f4498ed1969edcb4c7f93045
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:57.410354 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:57.390934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:59981 (local address 127.26.252.126:44037)
0807 06:19:57.395605 (+ 4671us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:57.395611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:57.395628 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:19:57.397239 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:57.397242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:57.397299 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:57.397389 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:57.399146 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.400050 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.401871 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.402239 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.402319 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:57.405610 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:57.405614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:57.405617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:57.405645 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:57.407581 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:57.408279 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:57.408283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:57.408285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:57.408386 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:57.408815 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:57.408819 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:57.408821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:57.409111 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:57.409207 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:57.409935 (+ 728us) server_negotiation.cc:299] Negotiation successful
0807 06:19:57.410139 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4585,"thread_start_us":75,"threads_started":1}
I20260807 06:19:57.412024 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:57.389698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.65:59981)
0807 06:19:57.391394 (+ 1696us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:57.391461 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:57.396855 (+ 5394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:57.397731 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:57.397745 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:57.398132 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:57.398952 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:57.398973 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.400219 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.400222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:57.401727 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:57.401739 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.402568 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.402572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:57.402804 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:57.403566 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:57.403587 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:57.405410 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:57.407717 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:57.407724 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:57.407742 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:57.408126 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:57.408504 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:57.408507 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:57.408510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:57.408698 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:57.409292 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:57.409299 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:57.409632 (+ 333us) client_negotiation.cc:769] Sending connection context
0807 06:19:57.410572 (+ 940us) client_negotiation.cc:240] Negotiation successful
0807 06:19:57.410933 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1415,"thread_start_us":143,"threads_started":1}
I20260807 06:19:57.413635 12475 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:57.413901 12475 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:57.414624 12475 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:57.416462 12176 ts_manager.cc:194] Registered new tserver with Master: 1005c20ee56a4497b281958a1ef846d7 (127.26.252.65:38503)
I20260807 06:19:57.418071 12176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:59981
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:19:57.450142 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:57.582978 12487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:57.583269 12487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:57.583348 12487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:57.587440 12487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:57.587522 12487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:57.587625 12487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:19:57.593392 12487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:57.594928 12487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:57.596329 12487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:57.609104 12497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:57.609192 12495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:57.609540 12487 server_base.cc:1034] running on GCE node
W20260807 06:19:57.609628 12494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:57.610570 12487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:57.611336 12487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:57.614609 12487 hybrid_clock.cc:648] HybridClock initialized: now 1786083597614578 us; error 43 us; skew 500 ppm
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:57.617779 12487 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:19:57.618885 12487 webserver.cc:460] Webserver started at http://127.26.252.66:40003/ using document root <none> and password file <none>
I20260807 06:19:57.619674 12487 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:57.619783 12487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:57.620028 12487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:57.637992 12487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "7fe29b894957467a8bc0068a4cc38f38"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "0d4b9806189e672d83078d393f68d811"
server_key_iv: "efc930ce81b4f7ccf18362dcf6fc9d52"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.638803 12487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "7fe29b894957467a8bc0068a4cc38f38"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "0d4b9806189e672d83078d393f68d811"
server_key_iv: "efc930ce81b4f7ccf18362dcf6fc9d52"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.643401 12487 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:19:57.664469 12510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:57.672590 12487 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.005s sys 0.000s
I20260807 06:19:57.673224 12487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "7fe29b894957467a8bc0068a4cc38f38"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "0d4b9806189e672d83078d393f68d811"
server_key_iv: "efc930ce81b4f7ccf18362dcf6fc9d52"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.673522 12487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:57.696097 12487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:57.699874 12487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:57.700136 12487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:57.700920 12487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:57.702030 12487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:57.702138 12487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:57.702265 12487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:57.702342 12487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:57.720189 12487 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35377
I20260807 06:19:57.721568 12487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:19:57.722460 12666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35377 every 8 connection(s)
I20260807 06:19:57.731004 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12487
I20260807 06:19:57.731150 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:19:57.731498 27633 external_mini_cluster.cc:1428] Setting key 2761b22c32b44d07a92da7131542f23b
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:57.740643 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:57.724629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:48119 (local address 127.26.252.126:44037)
0807 06:19:57.724780 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:57.724785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:57.726612 (+ 1827us) server_negotiation.cc:407] Connection header received
0807 06:19:57.727853 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:57.727857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:57.727917 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:57.727981 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:57.729723 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.730597 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.732584 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.732986 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.733068 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:57.736322 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:57.736326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:57.736329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:57.736356 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:57.738080 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:57.738768 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:57.738772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:57.738774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:57.738864 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:57.739308 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:57.739311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:57.739313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:57.739540 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:57.739632 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:57.740339 (+ 707us) server_negotiation.cc:299] Negotiation successful
0807 06:19:57.740474 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:19:57.742660 12669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:57.725134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.66:48119)
0807 06:19:57.726397 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:57.726481 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:57.727576 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:57.728436 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:57.728445 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:57.728824 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:57.729530 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:57.729552 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.730754 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.730758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:57.732428 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:57.732440 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:57.733332 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:57.733336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:57.733540 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:57.734244 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:57.734266 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:57.736106 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:57.738222 (+ 2116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:57.738228 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:57.738256 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:57.738646 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:57.738986 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:57.738989 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:57.738991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:57.739168 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:57.739707 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:57.739714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:57.740030 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 06:19:57.741094 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0807 06:19:57.741453 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"thread_start_us":158,"threads_started":1}
I20260807 06:19:57.744360 12667 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:57.744606 12667 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:57.745205 12667 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:57.746389 12176 ts_manager.cc:194] Registered new tserver with Master: 7fe29b894957467a8bc0068a4cc38f38 (127.26.252.66:35377)
I20260807 06:19:57.747164 12176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:48119
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:19:57.777737 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
W20260807 06:19:57.945636 12674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:57.945942 12674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:57.946028 12674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:57.950279 12674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:57.950367 12674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:57.950496 12674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:19:57.955895 12674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:57.957093 12674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:57.958177 12674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:57.969326 12679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:57.969344 12680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:57.969590 12682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:57.969923 12674 server_base.cc:1034] running on GCE node
I20260807 06:19:57.970430 12674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:57.971257 12674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:57.972550 12674 hybrid_clock.cc:648] HybridClock initialized: now 1786083597972528 us; error 33 us; skew 500 ppm
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:57.976277 12674 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:19:57.977458 12674 webserver.cc:460] Webserver started at http://127.26.252.67:34593/ using document root <none> and password file <none>
I20260807 06:19:57.978215 12674 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:57.978319 12674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:19:57.978672 12674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:19:57 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:57.997043 12674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "b14f5aeab8c94b628f34e1291b3294d5"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "357fd2353331d749e39912b0867eae95"
server_key_iv: "f224e2910cb6f4c95abc0731c7192d44"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:57.997900 12674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "b14f5aeab8c94b628f34e1291b3294d5"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "357fd2353331d749e39912b0867eae95"
server_key_iv: "f224e2910cb6f4c95abc0731c7192d44"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:58.011992 12674 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.003s sys 0.000s
I20260807 06:19:58.030362 12697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.040138 12674 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.000s
I20260807 06:19:58.040397 12674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "b14f5aeab8c94b628f34e1291b3294d5"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "357fd2353331d749e39912b0867eae95"
server_key_iv: "f224e2910cb6f4c95abc0731c7192d44"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:58.040670 12674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:58.069538 12674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:58.073565 12674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:58.073853 12674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:58.074594 12674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:58.075606 12674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:58.075655 12674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.075706 12674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:58.075727 12674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.086535 12674 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42101
I20260807 06:19:58.086843 12854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42101 every 8 connection(s)
I20260807 06:19:58.087707 12674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:19:58.094225 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12674
I20260807 06:19:58.094358 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:19:58.094729 27633 external_mini_cluster.cc:1428] Setting key 1f55f81f191bfd63c9b3389aac5484bf
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083597, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:58.105666 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.089999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:60393 (local address 127.26.252.126:44037)
0807 06:19:58.090153 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:58.090158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:58.091257 (+ 1099us) server_negotiation.cc:407] Connection header received
0807 06:19:58.092663 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:58.092667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:58.092720 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:58.092816 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:58.094468 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.095379 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.097417 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.097764 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.097871 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.101062 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:58.101074 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:58.101077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:58.101108 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:58.103086 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.103738 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.103742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.103744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.103844 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.104288 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.104293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.104295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.104543 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:58.104667 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:58.105348 (+ 681us) server_negotiation.cc:299] Negotiation successful
0807 06:19:58.105489 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:19:58.108943 12860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.090482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.67:60393)
0807 06:19:58.091079 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:58.091142 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:58.092393 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:58.093051 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:58.093072 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:58.093461 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:58.094228 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.094251 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.095632 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.095639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.097268 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.097280 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.097953 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.097958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.098196 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.098961 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:58.098986 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:58.100872 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:58.103223 (+ 2351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.103229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.103245 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.103610 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.103969 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.103972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.103974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.104166 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.104683 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:58.104690 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:58.105021 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 06:19:58.105839 (+ 818us) client_negotiation.cc:240] Negotiation successful
0807 06:19:58.106181 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":142,"threads_started":1}
I20260807 06:19:58.110273 12856 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:58.110595 12856 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:58.111269 12856 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:58.112471 12176 ts_manager.cc:194] Registered new tserver with Master: b14f5aeab8c94b628f34e1291b3294d5 (127.26.252.67:42101)
I20260807 06:19:58.113304 12176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:60393
I20260807 06:19:58.120182 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:19:58.121136 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12289
I20260807 06:19:58.171715 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12487
I20260807 06:19:58.183080 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12674
I20260807 06:19:58.205734 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12126
I20260807 06:19:58.222890 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44037
--webserver_interface=127.26.252.126
--webserver_port=43551
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44037
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:19:58.333935 12862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:58.334179 12862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:58.334218 12862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:58.338163 12862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:19:58.338219 12862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:58.338239 12862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:58.338255 12862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:19:58.338316 12862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:19:58.343644 12862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44037
--ranger_config_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:58.344612 12862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:58.345616 12862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:58.354333 12875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.354346 12870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.354449 12873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:58.354423 12862 server_base.cc:1034] running on GCE node
I20260807 06:19:58.355154 12862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:58.356209 12862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:58.357404 12862 hybrid_clock.cc:648] HybridClock initialized: now 1786083598357367 us; error 50 us; skew 500 ppm
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:58.360244 12862 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:19:58.361088 12862 webserver.cc:460] Webserver started at http://127.26.252.126:43551/ using document root <none> and password file <none>
I20260807 06:19:58.361564 12862 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:58.361629 12862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:58.411967 12862 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:19:58.415127 12886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.416663 12862 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:19:58.416848 12862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "d36f027ae7f7435d949750a13305b383"
format_stamp: "Formatted at 2026-08-07 06:19:56 on dist-test-slave-68xk"
server_key: "6c744fe8877cf07c529ae4a31039b26d"
server_key_iv: "0197ae6cfcb7674766e5c0ec87a64a07"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:58.417428 12862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:58.431281 12862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:58.434266 12862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:58.434526 12862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:58.441732 12862 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44037
I20260807 06:19:58.441744 12958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44037 every 8 connection(s)
I20260807 06:19:58.442816 12862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:19:58.447360 12960 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:19:58.449168 12960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Bootstrap starting.
I20260807 06:19:58.450470 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12862
I20260807 06:19:58.451053 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:38503
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:44037
--webserver_port=32879
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:19:58.468365 12960 log.cc:824] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Log is configured to *not* fsync() on all Append() calls
I20260807 06:19:58.475574 12960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:19:58.476022 12960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Bootstrap complete.
I20260807 06:19:58.480602 12960 raft_consensus.cc:348] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:58.481000 12960 raft_consensus.cc:729] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36f027ae7f7435d949750a13305b383, State: Initialized, Role: FOLLOWER
I20260807 06:19:58.481520 12960 consensus_queue.cc:260] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:58.481652 12960 raft_consensus.cc:388] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:19:58.481742 12960 raft_consensus.cc:482] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:19:58.481870 12960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:19:58.483953 12960 raft_consensus.cc:504] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:58.484321 12960 leader_election.cc:302] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d36f027ae7f7435d949750a13305b383; no voters:
I20260807 06:19:58.484658 12960 leader_election.cc:288] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:19:58.484822 12964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:19:58.485087 12964 raft_consensus.cc:686] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [term 2 LEADER]: Becoming Leader. State: Replica: d36f027ae7f7435d949750a13305b383, State: Running, Role: LEADER
I20260807 06:19:58.485463 12964 consensus_queue.cc:237] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } }
I20260807 06:19:58.485980 12960 sys_catalog.cc:564] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:19:58.486896 12965 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d36f027ae7f7435d949750a13305b383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } } }
I20260807 06:19:58.487046 12965 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:58.487552 12966 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36f027ae7f7435d949750a13305b383. Latest consensus state: current_term: 2 leader_uuid: "d36f027ae7f7435d949750a13305b383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36f027ae7f7435d949750a13305b383" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44037 } } }
I20260807 06:19:58.487705 12966 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383 [sys.catalog]: This master's current role is: LEADER
I20260807 06:19:58.487923 12974 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:19:58.491113 12974 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:19:58.491739 12960 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:19:58.491768 12974 catalog_manager.cc:1259] Loaded cluster ID: 031f35d6d546465282cd4be1099e8ef1
I20260807 06:19:58.491950 12974 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:19:58.494374 12974 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:19:58.495018 12974 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Loaded TSK: 0
I20260807 06:19:58.496146 12974 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:19:58.581640 12962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:58.582099 12962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:58.582227 12962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:58.586764 12962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:58.586911 12962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:58.587054 12962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:19:58.593326 12962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:38503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=32879
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:58.594563 12962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:58.595819 12962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:58.605815 13006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.605980 13009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.605793 13005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:58.606240 12962 server_base.cc:1034] running on GCE node
I20260807 06:19:58.606865 12962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:58.607620 12962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:58.608846 12962 hybrid_clock.cc:648] HybridClock initialized: now 1786083598608751 us; error 113 us; skew 500 ppm
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:58.613044 12962 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:19:58.614070 12962 webserver.cc:460] Webserver started at http://127.26.252.65:32879/ using document root <none> and password file <none>
I20260807 06:19:58.614809 12962 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:58.614945 12962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:58.636879 12962 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:19:58.640367 13018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.641968 12962 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 06:19:58.642107 12962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "1005c20ee56a4497b281958a1ef846d7"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "5167933cde63a4fbbcb4f69eedd31a6f"
server_key_iv: "a1ebc7aafc94a7fcb8550f1b73c6e387"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:58.642830 12962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:58.666456 12962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:58.670068 12962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:58.670274 12962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:58.671034 12962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:58.672060 12962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:58.672132 12962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.672186 12962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:58.672245 12962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 06:19:58.683730 12962 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38503
I20260807 06:19:58.683785 13166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38503 every 8 connection(s)
I20260807 06:19:58.685024 12962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:19:58.691444 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 12962
I20260807 06:19:58.691936 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:35377
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:44037
--webserver_port=40003
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:58.706758 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.687675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.65:34293)
0807 06:19:58.689626 (+ 1951us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:58.689685 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:58.690892 (+ 1207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:58.692809 (+ 1917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:58.692817 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:58.693188 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:58.693836 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.693857 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.695830 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.695833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.697241 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.697256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.698557 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.698560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.698701 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.699345 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:58.699362 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:58.701104 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:58.703316 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.703323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.703339 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.703592 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.703995 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.703998 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.704000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.704169 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.705025 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:58.705031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:58.705318 (+ 287us) client_negotiation.cc:769] Sending connection context
0807 06:19:58.705526 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 06:19:58.705874 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1728,"thread_start_us":149,"threads_started":1}
I20260807 06:19:58.707113 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.687498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:34293 (local address 127.26.252.126:44037)
0807 06:19:58.688168 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:58.688191 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:58.690480 (+ 2289us) server_negotiation.cc:407] Connection header received
0807 06:19:58.691513 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:58.691528 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:58.691923 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:58.692295 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:58.694033 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.695660 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.697398 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.698107 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.698285 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.701304 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:58.701309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:58.701321 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:58.701347 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:58.703173 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.703722 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.703728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.703733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.703875 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.704302 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.704308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.704312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.704872 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:58.705041 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:58.705702 (+ 661us) server_negotiation.cc:299] Negotiation successful
0807 06:19:58.706031 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":149,"threads_started":1}
I20260807 06:19:58.715372 13167 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:58.715663 13167 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:58.716193 13167 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
W20260807 06:19:58.718493 13167 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:44037 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:19:58.718621 13167 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:58.718808 13167 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:58.719784 13167 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:58.719962 13167 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
W20260807 06:19:58.720870 13167 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:19:58.863734 13175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:58.864114 13175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:58.864202 13175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:58.871227 13175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:58.871373 13175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:58.871505 13175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:19:58.880409 13175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:35377
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=40003
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:58.882030 13175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:58.883639 13175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:58.896255 13187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.896276 13184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:58.896397 13183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:58.897275 13175 server_base.cc:1034] running on GCE node
I20260807 06:19:58.897739 13175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:58.898578 13175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:58.899818 13175 hybrid_clock.cc:648] HybridClock initialized: now 1786083598899745 us; error 84 us; skew 500 ppm
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:58.903755 13175 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:19:58.904884 13175 webserver.cc:460] Webserver started at http://127.26.252.66:40003/ using document root <none> and password file <none>
I20260807 06:19:58.905639 13175 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:58.905748 13175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:58.925554 13175 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.002s sys 0.001s
I20260807 06:19:58.929184 13204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.931021 13175 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260807 06:19:58.931205 13175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "7fe29b894957467a8bc0068a4cc38f38"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "0d4b9806189e672d83078d393f68d811"
server_key_iv: "efc930ce81b4f7ccf18362dcf6fc9d52"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:58.931978 13175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:58.952692 13175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:58.956925 13175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:58.957204 13175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:58.958053 13175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:58.959273 13175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:58.959345 13175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.959406 13175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:58.959491 13175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:58.972138 13175 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35377
I20260807 06:19:58.972219 13355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35377 every 8 connection(s)
I20260807 06:19:58.973577 13175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:19:58.976876 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 13175
I20260807 06:19:58.977386 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.252.84:40021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:42101
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:44037
--webserver_port=34593
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:37841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:19:58 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083598, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:58.994333 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.976067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:59657 (local address 127.26.252.126:44037)
0807 06:19:58.976211 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:58.976216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:58.978050 (+ 1834us) server_negotiation.cc:407] Connection header received
0807 06:19:58.979345 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:58.979349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:58.979409 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:58.979468 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:58.981201 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.982055 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.983819 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.984179 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.984304 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.989761 (+ 5457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:58.989768 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:58.989773 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:58.989807 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:58.991728 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.992404 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.992408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.992410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.992505 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:58.992961 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:58.992965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:58.992967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:58.993196 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:58.993282 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:58.994009 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 06:19:58.994152 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:19:58.995972 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:58.976607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.66:59657)
0807 06:19:58.977879 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:58.977937 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:58.979077 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:58.979932 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:58.979941 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:58.980299 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:58.981000 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.981023 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.982222 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.982226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.983651 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:58.983663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:58.984504 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:58.984510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:58.984724 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:58.985468 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:58.985490 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:58.989529 (+ 4039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:58.991885 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.991891 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.991908 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.992275 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.992626 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:58.992629 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:58.992631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:58.992835 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:58.993354 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:58.993360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:58.993695 (+ 335us) client_negotiation.cc:769] Sending connection context
0807 06:19:58.994546 (+ 851us) client_negotiation.cc:240] Negotiation successful
0807 06:19:58.994915 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"thread_start_us":172,"threads_started":1}
I20260807 06:19:58.997599 13357 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:58.997865 13357 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:58.998467 13357 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
W20260807 06:19:59.000234 13357 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:44037 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:19:59.000375 13357 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.000555 13357 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:59.001513 13357 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.001691 13357 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
W20260807 06:19:59.002562 13357 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:19:59.129678 13361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:19:59.130119 13361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:19:59.130242 13361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:19:59.135385 13361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:19:59.135461 13361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:19:59.135568 13361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:19:59.141054 13361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.252.84:40021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:42101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=34593
--tserver_master_addrs=127.26.252.126:44037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:19:59.142097 13361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:19:59.143230 13361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:19:59.154481 13372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:19:59.154758 13368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:59.154865 13361 server_base.cc:1034] running on GCE node
W20260807 06:19:59.156067 13374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:19:59.156500 13361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:19:59.157172 13361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:19:59.158360 13361 hybrid_clock.cc:648] HybridClock initialized: now 1786083599158342 us; error 29 us; skew 500 ppm
Aug 07 06:19:59 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:59.161243 13361 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:19:59.162195 13361 webserver.cc:460] Webserver started at http://127.26.252.67:34593/ using document root <none> and password file <none>
I20260807 06:19:59.162843 13361 fs_manager.cc:359] Metadata directory not provided
I20260807 06:19:59.162921 13361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:19:59 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:19:59.183250 13361 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:19:59.186044 13384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:59.187842 13361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:19:59.188052 13361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "b14f5aeab8c94b628f34e1291b3294d5"
format_stamp: "Formatted at 2026-08-07 06:19:57 on dist-test-slave-68xk"
server_key: "357fd2353331d749e39912b0867eae95"
server_key_iv: "f224e2910cb6f4c95abc0731c7192d44"
server_key_version: "kuduclusterkey@0"
I20260807 06:19:59.188855 13361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:19:59.211971 13361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:19:59.215477 13361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:19:59.215705 13361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:19:59.216377 13361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:19:59.217334 13361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:19:59.217407 13361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:59.217515 13361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:19:59.217571 13361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:19:59.229620 13361 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42101
I20260807 06:19:59.229708 13541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42101 every 8 connection(s)
I20260807 06:19:59.231047 13361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:19:59.232887 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 13361
Aug 07 06:19:59 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:19:59.247257 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:59.234864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:35501 (local address 127.26.252.126:44037)
0807 06:19:59.235165 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:59.235169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:59.235190 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:19:59.235924 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:59.235928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:59.235986 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:59.236085 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:59.237664 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.238535 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.240219 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.240569 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.240642 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:59.243565 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:59.243571 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:59.243577 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:59.243637 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:59.245151 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:59.245693 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:59.245696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:59.245698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:59.245794 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:59.246143 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:59.246148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:59.246150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:59.246331 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:59.246477 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:59.246955 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 06:19:59.247075 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":221}
I20260807 06:19:59.248242 13546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:59.233710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44037 (local address 127.26.252.67:35501)
0807 06:19:59.234581 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 06:19:59.234638 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:19:59.235671 (+ 1033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:19:59.236442 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:19:59.236451 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:19:59.236805 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:19:59.237485 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:59.237507 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.238699 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.238702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:59.240072 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:19:59.240083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.240831 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.240835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:19:59.241027 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:59.241608 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:19:59.241630 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:19:59.243344 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:19:59.245281 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:59.245286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:59.245302 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:59.245578 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:59.245891 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:19:59.245894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:19:59.245896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:19:59.246040 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:19:59.246467 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:19:59.246473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:19:59.246716 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 06:19:59.246911 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 06:19:59.247211 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":153,"threads_started":1}
I20260807 06:19:59.249547 13542 heartbeater.cc:347] Connected to a master server at 127.26.252.126:44037
I20260807 06:19:59.249809 13542 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.250384 13542 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:59.250830 13547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:19:59.234935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35428 (local address 127.26.252.126:44037)
0807 06:19:59.236100 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0807 06:19:59.236109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:19:59.236123 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:19:59.236161 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:19:59.236164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:19:59.236219 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:19:59.237311 (+ 1092us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:19:59.237418 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.238301 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.239661 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:19:59.240000 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:19:59.242991 (+ 2991us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:19:59.243125 (+ 134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:19:59.243129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:19:59.243132 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:19:59.243150 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:19:59.248361 (+ 5211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:59.248959 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:59.248962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:59.248964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:59.249048 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:19:59.249432 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:19:59.249436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:19:59.249438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:19:59.249643 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:19:59.250445 (+ 802us) server_negotiation.cc:1035] Waiting for connection context
0807 06:19:59.250529 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:19:59.250653 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":98,"threads_started":1}
W20260807 06:19:59.252570 13542 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:44037 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:19:59.252708 13542 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.252887 13542 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:59.253755 13542 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.253939 13542 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
W20260807 06:19:59.254822 13542 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 06:19:59 dist-test-slave-68xk krb5kdc[11503](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:19:59.721190 13167 heartbeater.cc:464] Registering TS with master...
I20260807 06:19:59.721552 13167 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:19:59.722800 12905 ts_manager.cc:194] Registered new tserver with Master: 1005c20ee56a4497b281958a1ef846d7 (127.26.252.65:38503)
I20260807 06:19:59.724462 12905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:34293
I20260807 06:20:00.002825 13357 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:00.003312 13357 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:20:00.004364 12905 ts_manager.cc:194] Registered new tserver with Master: 7fe29b894957467a8bc0068a4cc38f38 (127.26.252.66:35377)
I20260807 06:20:00.005261 12905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:59657
Aug 07 06:20:00 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:20:00.255060 13542 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:00.255357 13542 heartbeater.cc:511] Master 127.26.252.126:44037 requested a full tablet report, sending...
I20260807 06:20:00.256168 12905 ts_manager.cc:194] Registered new tserver with Master: b14f5aeab8c94b628f34e1291b3294d5 (127.26.252.67:42101)
I20260807 06:20:00.256948 12905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:35501
I20260807 06:20:00.261022 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:20:00.272811 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.262772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35430 (local address 127.26.252.126:44037)
0807 06:20:00.263375 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.263380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.263601 (+ 221us) server_negotiation.cc:407] Connection header received
0807 06:20:00.263792 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.263795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.263841 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.263899 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:00.264810 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.265631 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.266851 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.267191 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.267264 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.269059 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:00.269063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:00.269066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:00.269091 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:00.270962 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:00.271466 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:00.271469 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:00.271471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:00.271555 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:00.271851 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:00.271854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:00.271856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:00.272051 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:00.272151 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.272488 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.272630 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":79,"threads_started":1}
I20260807 06:20:00.277683 12905 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:20:00.282600 12905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:20:00.312940 13595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.302792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35377 (local address 127.0.0.1:40756)
0807 06:20:00.305375 (+ 2583us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.305388 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:00.305476 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:00.306206 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:00.306213 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:00.306237 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:00.306381 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.306389 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.308926 (+ 2537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.308930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.311055 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.311068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.312370 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.312374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.312489 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.312530 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:20:00.312644 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:20:00.312776 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2523,"thread_start_us":97,"threads_started":1}
I20260807 06:20:00.313562 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.302979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40756 (local address 127.26.252.66:35377)
0807 06:20:00.305234 (+ 2255us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.305241 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.305566 (+ 325us) server_negotiation.cc:407] Connection header received
0807 06:20:00.305649 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.305654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.305880 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.306019 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:00.307299 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.308507 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.311208 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.312037 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.312146 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.312302 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.313314 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.313419 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2146,"thread_start_us":136,"threads_started":1}
I20260807 06:20:00.318270 13250 tablet_service.cc:1467] Processing CreateTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca (DEFAULT_TABLE table=test-table [id=ea0b99daf72f40c188487fd48de743cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:00.319839 13250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6846eb1e3f840a8aa808f64eb34a8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:00.320201 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.300982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38503 (local address 127.0.0.1:56190)
0807 06:20:00.304757 (+ 3775us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.304809 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:00.304935 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:00.315276 (+ 10341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:00.315280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:00.315301 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:00.315398 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.315405 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.317155 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.317159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.318464 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.318479 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.319735 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.319739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.319839 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.319878 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:20:00.319944 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:20:00.320027 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2882,"thread_start_us":90,"threads_started":1}
I20260807 06:20:00.321228 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.303432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42101 (local address 127.0.0.1:58068)
0807 06:20:00.308745 (+ 5313us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.308759 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:00.308838 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:00.315797 (+ 6959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:00.315800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:00.315819 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:00.315903 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.315909 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.317320 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.317324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.319549 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.319561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.320736 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.320740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.320847 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.320873 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:20:00.320922 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:20:00.321031 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5236,"thread_start_us":105,"threads_started":1}
I20260807 06:20:00.321233 13594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.301193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56190 (local address 127.26.252.65:38503)
0807 06:20:00.314680 (+ 13487us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.314688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.314719 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:20:00.314819 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.314829 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.315078 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.315573 (+ 495us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:00.315745 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.316984 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.318654 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.319568 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.320745 (+ 1177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.320911 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.320972 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.321072 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13333,"thread_start_us":113,"threads_started":1}
I20260807 06:20:00.322036 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.303629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.26.252.67:42101)
0807 06:20:00.315176 (+ 11547us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.315183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.315208 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:20:00.315286 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.315291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.315483 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.315629 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:00.316044 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.317168 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.319738 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.320577 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.321567 (+ 990us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.321735 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.321791 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.321890 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11432,"thread_start_us":117,"threads_started":1}
I20260807 06:20:00.325855 13054 tablet_service.cc:1467] Processing CreateTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca (DEFAULT_TABLE table=test-table [id=ea0b99daf72f40c188487fd48de743cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:00.328789 13451 tablet_service.cc:1467] Processing CreateTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca (DEFAULT_TABLE table=test-table [id=ea0b99daf72f40c188487fd48de743cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:00.329919 13451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6846eb1e3f840a8aa808f64eb34a8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:00.332185 13054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6846eb1e3f840a8aa808f64eb34a8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:00.337549 13600 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Bootstrap starting.
I20260807 06:20:00.340896 13600 tablet_bootstrap.cc:654] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:00.341943 13600 log.cc:824] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:00.344910 13600 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: No bootstrap required, opened a new log
I20260807 06:20:00.345162 13600 ts_tablet_manager.cc:1397] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260807 06:20:00.349926 13600 raft_consensus.cc:348] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.350226 13600 raft_consensus.cc:374] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:00.350292 13600 raft_consensus.cc:729] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe29b894957467a8bc0068a4cc38f38, State: Initialized, Role: FOLLOWER
I20260807 06:20:00.351130 13600 consensus_queue.cc:260] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.352485 13600 ts_tablet_manager.cc:1428] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260807 06:20:00.352975 13357 heartbeater.cc:503] Master 127.26.252.126:44037 was elected leader, sending a full tablet report...
I20260807 06:20:00.357887 13604 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Bootstrap starting.
I20260807 06:20:00.363327 13604 tablet_bootstrap.cc:654] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:00.364560 13604 log.cc:824] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:00.365592 13606 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Bootstrap starting.
I20260807 06:20:00.368772 13606 tablet_bootstrap.cc:654] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:00.371160 13606 log.cc:824] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:00.374701 13604 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: No bootstrap required, opened a new log
I20260807 06:20:00.375041 13604 ts_tablet_manager.cc:1397] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260807 06:20:00.381342 13604 raft_consensus.cc:348] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.381872 13604 raft_consensus.cc:374] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:00.382006 13604 raft_consensus.cc:729] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1005c20ee56a4497b281958a1ef846d7, State: Initialized, Role: FOLLOWER
I20260807 06:20:00.382764 13604 consensus_queue.cc:260] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.384223 13604 ts_tablet_manager.cc:1428] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260807 06:20:00.387370 13167 heartbeater.cc:503] Master 127.26.252.126:44037 was elected leader, sending a full tablet report...
I20260807 06:20:00.392755 13606 tablet_bootstrap.cc:492] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: No bootstrap required, opened a new log
I20260807 06:20:00.393093 13606 ts_tablet_manager.cc:1397] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.000s
I20260807 06:20:00.398811 13606 raft_consensus.cc:348] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.399150 13606 raft_consensus.cc:374] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:00.399221 13606 raft_consensus.cc:729] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14f5aeab8c94b628f34e1291b3294d5, State: Initialized, Role: FOLLOWER
I20260807 06:20:00.399780 13606 consensus_queue.cc:260] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.400766 13542 heartbeater.cc:503] Master 127.26.252.126:44037 was elected leader, sending a full tablet report...
I20260807 06:20:00.400990 13606 ts_tablet_manager.cc:1428] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260807 06:20:00.437605 13169 tablet.cc:2369] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:20:00 dist-test-slave-68xk krb5kdc[11503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083599, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for HTTP/127.26.252.84@KRBTEST.COM
I20260807 06:20:00.470642 13603 raft_consensus.cc:482] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:00.470906 13603 raft_consensus.cc:504] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.472319 13603 leader_election.cc:288] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1005c20ee56a4497b281958a1ef846d7 (127.26.252.65:38503), b14f5aeab8c94b628f34e1291b3294d5 (127.26.252.67:42101)
W20260807 06:20:00.475822 13358 tablet.cc:2369] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:00.478477 13594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.473411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:58617 (local address 127.26.252.65:38503)
0807 06:20:00.473529 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.473534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.473792 (+ 258us) server_negotiation.cc:407] Connection header received
0807 06:20:00.473889 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.473893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.473955 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.474033 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:00.474387 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.475261 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.477107 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.477700 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.477808 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.477864 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.478238 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.478317 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:20:00.478978 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.472842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:42595 (local address 127.26.252.67:42101)
0807 06:20:00.472988 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.472993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.473740 (+ 747us) server_negotiation.cc:407] Connection header received
0807 06:20:00.473927 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.473930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.473984 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.474076 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:00.474534 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.475289 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.477592 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.478192 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.478290 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.478338 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.478755 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.478836 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:20:00.479372 13614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.472728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42101 (local address 127.26.252.66:42595)
0807 06:20:00.473610 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.473625 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:00.473757 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:00.474196 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:00.474200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:00.474220 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:00.474373 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.474380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.475443 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.475446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.477445 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.477456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.478472 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.478478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.478586 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.478608 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:20:00.479136 (+ 528us) client_negotiation.cc:240] Negotiation successful
0807 06:20:00.479218 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"mutex_wait_us":839,"thread_start_us":135,"threads_started":1}
I20260807 06:20:00.479352 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.473273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38503 (local address 127.26.252.66:58617)
0807 06:20:00.473626 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.473639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:00.473786 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:00.474064 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:00.474067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:00.474086 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:00.474246 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.474252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.475411 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.475415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.476931 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:00.476944 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.477967 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.477970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:00.478091 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.478114 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:20:00.478845 (+ 731us) client_negotiation.cc:240] Negotiation successful
0807 06:20:00.478926 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":10,"spinlock_wait_cycles":18176,"thread_start_us":105,"threads_started":1}
I20260807 06:20:00.480212 13476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6846eb1e3f840a8aa808f64eb34a8ca" candidate_uuid: "7fe29b894957467a8bc0068a4cc38f38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14f5aeab8c94b628f34e1291b3294d5" is_pre_election: true
I20260807 06:20:00.480434 13106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6846eb1e3f840a8aa808f64eb34a8ca" candidate_uuid: "7fe29b894957467a8bc0068a4cc38f38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1005c20ee56a4497b281958a1ef846d7" is_pre_election: true
I20260807 06:20:00.480552 13476 raft_consensus.cc:2454] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe29b894957467a8bc0068a4cc38f38 in term 0.
I20260807 06:20:00.480691 13106 raft_consensus.cc:2454] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe29b894957467a8bc0068a4cc38f38 in term 0.
I20260807 06:20:00.481088 13207 leader_election.cc:302] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe29b894957467a8bc0068a4cc38f38, b14f5aeab8c94b628f34e1291b3294d5; no voters:
I20260807 06:20:00.481374 13603 raft_consensus.cc:2781] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:00.481477 13603 raft_consensus.cc:482] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:00.481527 13603 raft_consensus.cc:3037] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 0 FOLLOWER]: Advancing to term 1
W20260807 06:20:00.483034 13544 tablet.cc:2369] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:00.483016 13603 raft_consensus.cc:504] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.483388 13603 leader_election.cc:288] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [CANDIDATE]: Term 1 election: Requested vote from peers 1005c20ee56a4497b281958a1ef846d7 (127.26.252.65:38503), b14f5aeab8c94b628f34e1291b3294d5 (127.26.252.67:42101)
I20260807 06:20:00.483911 13106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6846eb1e3f840a8aa808f64eb34a8ca" candidate_uuid: "7fe29b894957467a8bc0068a4cc38f38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1005c20ee56a4497b281958a1ef846d7"
I20260807 06:20:00.484041 13106 raft_consensus.cc:3037] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:00.485188 13106 raft_consensus.cc:2454] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe29b894957467a8bc0068a4cc38f38 in term 1.
I20260807 06:20:00.485525 13210 leader_election.cc:302] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1005c20ee56a4497b281958a1ef846d7, 7fe29b894957467a8bc0068a4cc38f38; no voters:
I20260807 06:20:00.485749 13476 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6846eb1e3f840a8aa808f64eb34a8ca" candidate_uuid: "7fe29b894957467a8bc0068a4cc38f38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14f5aeab8c94b628f34e1291b3294d5"
I20260807 06:20:00.485916 13476 raft_consensus.cc:3037] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:00.487241 13476 raft_consensus.cc:2454] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe29b894957467a8bc0068a4cc38f38 in term 1.
I20260807 06:20:00.487711 13603 raft_consensus.cc:2781] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:00.487911 13603 raft_consensus.cc:686] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 1 LEADER]: Becoming Leader. State: Replica: 7fe29b894957467a8bc0068a4cc38f38, State: Running, Role: LEADER
I20260807 06:20:00.488261 13603 consensus_queue.cc:237] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } }
I20260807 06:20:00.492077 12905 catalog_manager.cc:5495] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe29b894957467a8bc0068a4cc38f38 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "7fe29b894957467a8bc0068a4cc38f38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe29b894957467a8bc0068a4cc38f38" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 } health_report { overall_health: UNKNOWN } } }
I20260807 06:20:00.506839 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.501411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40764 (local address 127.26.252.66:35377)
0807 06:20:00.501533 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:00.501538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:00.501554 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:20:00.501700 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:00.501703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:00.501769 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:00.501887 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:00.502191 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.503069 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.504356 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:00.504693 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:00.504803 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:00.505439 (+ 636us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:00.505983 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:00.506106 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:00.506556 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 06:20:00.506628 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:20:00.514799 13476 raft_consensus.cc:1261] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 1 FOLLOWER]: Refusing update from remote peer 7fe29b894957467a8bc0068a4cc38f38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:00.515810 13106 raft_consensus.cc:1261] T a6846eb1e3f840a8aa808f64eb34a8ca P 1005c20ee56a4497b281958a1ef846d7 [term 1 FOLLOWER]: Refusing update from remote peer 7fe29b894957467a8bc0068a4cc38f38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:00.515926 13616 consensus_queue.cc:1035] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14f5aeab8c94b628f34e1291b3294d5" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:00.516597 13616 consensus_queue.cc:1035] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1005c20ee56a4497b281958a1ef846d7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:00.530794 13623 mvcc.cc:205] Tried to move back new op lower bound from 7315798427698827264 to 7315798427604217856. Current Snapshot: MvccSnapshot[applied={T|T < 7315798427698827264}]
I20260807 06:20:00.535435 13624 mvcc.cc:205] Tried to move back new op lower bound from 7315798427698827264 to 7315798427604217856. Current Snapshot: MvccSnapshot[applied={T|T < 7315798427698827264}]
I20260807 06:20:00.536173 13625 mvcc.cc:205] Tried to move back new op lower bound from 7315798427698827264 to 7315798427604217856. Current Snapshot: MvccSnapshot[applied={T|T < 7315798427698827264}]
I20260807 06:20:00.562680 12905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:00.562904 12905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:00.566192 12905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d36f027ae7f7435d949750a13305b383: Sending DeleteTablet for 3 replicas of tablet a6846eb1e3f840a8aa808f64eb34a8ca
I20260807 06:20:00.567615 13250 tablet_service.cc:1514] Processing DeleteTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:00 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:40756
I20260807 06:20:00.568199 13451 tablet_service.cc:1514] Processing DeleteTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:00 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:58068
I20260807 06:20:00.569356 13054 tablet_service.cc:1514] Processing DeleteTablet for tablet a6846eb1e3f840a8aa808f64eb34a8ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:00 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:56190
I20260807 06:20:00.570765 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12962
I20260807 06:20:00.593281 13638 tablet_replica.cc:330] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: stopping tablet replica
I20260807 06:20:00.593652 13639 tablet_replica.cc:330] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: stopping tablet replica
I20260807 06:20:00.594429 13638 raft_consensus.cc:2229] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:20:00.594720 13639 raft_consensus.cc:2229] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:00.595198 13639 raft_consensus.cc:2258] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:00.595721 13638 raft_consensus.cc:2258] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:00.597987 13638 ts_tablet_manager.cc:1905] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:00.599756 13639 ts_tablet_manager.cc:1905] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:00.603250 13639 ts_tablet_manager.cc:1918] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:00.606307 13638 ts_tablet_manager.cc:1918] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:00.609380 13638 log.cc:1196] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/a6846eb1e3f840a8aa808f64eb34a8ca
I20260807 06:20:00.609905 13638 ts_tablet_manager.cc:1939] T a6846eb1e3f840a8aa808f64eb34a8ca P 7fe29b894957467a8bc0068a4cc38f38: Deleting consensus metadata
I20260807 06:20:00.610111 13639 log.cc:1196] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/a6846eb1e3f840a8aa808f64eb34a8ca
I20260807 06:20:00.610664 13639 ts_tablet_manager.cc:1939] T a6846eb1e3f840a8aa808f64eb34a8ca P b14f5aeab8c94b628f34e1291b3294d5: Deleting consensus metadata
I20260807 06:20:00.612237 12887 catalog_manager.cc:4841] TS 7fe29b894957467a8bc0068a4cc38f38 (127.26.252.66:35377): tablet a6846eb1e3f840a8aa808f64eb34a8ca (table test-table [id=ea0b99daf72f40c188487fd48de743cb]) successfully deleted
W20260807 06:20:00.612820 12891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:38503 (error 108)
I20260807 06:20:00.615084 12889 catalog_manager.cc:4841] TS b14f5aeab8c94b628f34e1291b3294d5 (127.26.252.67:42101): tablet a6846eb1e3f840a8aa808f64eb34a8ca (table test-table [id=ea0b99daf72f40c188487fd48de743cb]) successfully deleted
I20260807 06:20:00.615476 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 13175
I20260807 06:20:00.620599 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:00.620129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38503 (local address 127.0.0.1:56202)
0807 06:20:00.620374 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:00.620466 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260807 06:20:00.620910 12891 catalog_manager.cc:4584] TS 1005c20ee56a4497b281958a1ef846d7 (127.26.252.65:38503): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6846eb1e3f840a8aa808f64eb34a8ca: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38503: connect: Connection refused (error 111)
I20260807 06:20:00.628604 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 13361
I20260807 06:20:00.643057 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 12862
I20260807 06:20:00.656332 27633 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:20:01.003376 27633 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:20:01.003513 27633 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:20:01.358601 27633 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:20:01.358 UTC [11539] LOG: received smart shutdown request
2026-08-07 06:20:01.363 UTC [11539] LOG: background worker "logical replication launcher" (PID 11555) exited with exit code 1
2026-08-07 06:20:01.364 UTC [11547] LOG: shutting down
2026-08-07 06:20:01.550 UTC [11539] LOG: database system is shut down
2026-08-07T06:20:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51456 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:20:01 dist-test-slave-68xk krb5kdc[13656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:20:01 dist-test-slave-68xk krb5kdc[13656](info): set up 2 sockets
Aug 07 06:20:01 dist-test-slave-68xk krb5kdc[13656](info): commencing operation
krb5kdc: starting...
W20260807 06:20:02.910220 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:20:02 dist-test-slave-68xk krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:20:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:20:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:20:03.048074 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44205
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:03.164831 13679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:03.165103 13679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:03.165150 13679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:03.169031 13679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:03.169078 13679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:03.169097 13679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:03.169113 13679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:03.169129 13679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:03.174113 13679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:03.175170 13679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:03.176134 13679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:03.184825 13686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:03.184819 13688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:03.184816 13685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:03.185258 13679 server_base.cc:1034] running on GCE node
I20260807 06:20:03.185810 13679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:03.186940 13679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:03.188102 13679 hybrid_clock.cc:648] HybridClock initialized: now 1786083603188071 us; error 43 us; skew 500 ppm
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:03.191083 13679 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:03.192039 13679 webserver.cc:460] Webserver started at http://127.26.252.126:42651/ using document root <none> and password file <none>
I20260807 06:20:03.192598 13679 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:03.192699 13679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:03.192939 13679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:03.195045 13679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "9df6a03b08ac4f16a9fecad79e6c7321"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "434c300e1a71033dd99912cfc9e087a5"
server_key_iv: "7b7dc1346bddff0da091558ab6fffec8"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.195664 13679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "9df6a03b08ac4f16a9fecad79e6c7321"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "434c300e1a71033dd99912cfc9e087a5"
server_key_iv: "7b7dc1346bddff0da091558ab6fffec8"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.199806 13679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:03.202255 13696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:03.203685 13679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:03.203864 13679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "9df6a03b08ac4f16a9fecad79e6c7321"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "434c300e1a71033dd99912cfc9e087a5"
server_key_iv: "7b7dc1346bddff0da091558ab6fffec8"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.203996 13679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:03.217449 13679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:03.221064 13679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:03.221290 13679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:03.229539 13679 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44205
I20260807 06:20:03.229866 13776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44205 every 8 connection(s)
I20260807 06:20:03.230712 13679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:03.233614 13777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:03.235618 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 13679
I20260807 06:20:03.235790 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:20:03.236089 27633 external_mini_cluster.cc:1428] Setting key 69661a24305b2917f3b338e5e3caad8f
I20260807 06:20:03.237689 13777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.252.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.125@KRBTEST.COM" created.
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:03.255771 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.240234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44205 (local address 127.0.0.1:53990)
0807 06:20:03.240837 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.240902 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.242143 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.242967 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.242975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.243498 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.243874 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.243893 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.245207 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.245214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.246333 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.246343 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.247271 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.247274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.247364 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.247891 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.247906 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.250186 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.252527 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.252536 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.252543 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.252783 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.253220 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.253222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.253223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.253336 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.254225 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.254259 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.254487 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.254651 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.254913 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":151,"threads_started":1}
I20260807 06:20:03.255779 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.240234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53990 (local address 127.26.252.126:44205)
0807 06:20:03.240832 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.240851 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.241040 (+ 189us) server_negotiation.cc:407] Connection header received
0807 06:20:03.242544 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.242549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.242741 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.242902 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.244044 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.245036 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.246499 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.247065 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.247204 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.250351 (+ 3147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.250357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.250366 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.250388 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.252363 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.252910 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.252920 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.252925 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.253101 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.253440 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.253447 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.253452 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.254079 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.254227 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.254786 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.255039 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":467,"spinlock_wait_cycles":29952,"thread_start_us":186,"threads_started":1}
I20260807 06:20:03.258704 13777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.259745 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.259357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55798)
0807 06:20:03.259599 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.259685 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260807 06:20:03.259985 13697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
I20260807 06:20:03.261045 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.260786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55814)
0807 06:20:03.260916 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.260971 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 06:20:03.261204 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:45561: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
I20260807 06:20:03.270310 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:45561
--webserver_interface=127.26.252.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:03.310497 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } attempt: 1
I20260807 06:20:03.311415 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.311069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55816)
0807 06:20:03.311256 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.311331 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 06:20:03.312242 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.311992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55826)
0807 06:20:03.312123 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.312180 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:20:03.312373 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:45561: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
I20260807 06:20:03.380550 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } attempt: 2
I20260807 06:20:03.381451 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.381135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55830)
0807 06:20:03.381293 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.381369 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 06:20:03.382280 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.382058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55832)
0807 06:20:03.382169 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.382217 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:20:03.382547 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:45561: Network error: Client connection negotiation failed: client connection to 127.26.252.125:45561: connect: Connection refused (error 111)
W20260807 06:20:03.387446 13786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:03.387730 13786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:03.387841 13786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:03.391901 13786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:03.391975 13786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:03.392043 13786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:03.392098 13786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:03.392133 13786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:03.397449 13786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:45561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.252.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:03.398663 13786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:03.399734 13786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:03.408607 13796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:03.408569 13798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:03.408627 13791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:03.409113 13786 server_base.cc:1034] running on GCE node
I20260807 06:20:03.409749 13786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:03.410936 13786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:03.412146 13786 hybrid_clock.cc:648] HybridClock initialized: now 1786083603412123 us; error 34 us; skew 500 ppm
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:03.415302 13786 init.cc:377] Logged in from keytab as kudu/127.26.252.125@KRBTEST.COM (short username kudu)
I20260807 06:20:03.416492 13786 webserver.cc:460] Webserver started at http://127.26.252.125:40481/ using document root <none> and password file <none>
I20260807 06:20:03.417295 13786 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:03.417392 13786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:03.417613 13786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:03.419979 13786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data/instance:
uuid: "c204479baf984bb6aa20dc17112b9c10"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "53597fb9258a328d48a1c45f816e2093"
server_key_iv: "31811098fda025e16e8fea9fd93238e6"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.420571 13786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal/instance:
uuid: "c204479baf984bb6aa20dc17112b9c10"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "53597fb9258a328d48a1c45f816e2093"
server_key_iv: "31811098fda025e16e8fea9fd93238e6"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.424439 13786 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:20:03.427137 13807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:03.428395 13786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:03.428541 13786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "c204479baf984bb6aa20dc17112b9c10"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "53597fb9258a328d48a1c45f816e2093"
server_key_iv: "31811098fda025e16e8fea9fd93238e6"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.428654 13786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:03.451676 13786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:03.454996 13786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:03.455209 13786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:03.462098 13786 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.125:45561
I20260807 06:20:03.462370 13881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.125:45561 every 8 connection(s)
I20260807 06:20:03.463140 13786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
I20260807 06:20:03.465894 13882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:03.467818 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 13786
I20260807 06:20:03.467942 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-1/wal/instance
I20260807 06:20:03.468245 27633 external_mini_cluster.cc:1428] Setting key 797355930fa018a7628bee75ab440ab9
I20260807 06:20:03.470867 13882 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.473734 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } attempt: 3
WARNING: no policy specified for kudu/127.26.252.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.124@KRBTEST.COM" created.
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:03.486577 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.474201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55846)
0807 06:20:03.474310 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.474325 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.474435 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.475571 (+ 1136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.475574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.475792 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.475917 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.475924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.477501 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.477505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.478142 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.478157 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.479040 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.479044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.479295 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.479979 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.479997 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.481593 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.484228 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.484235 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.484238 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.484484 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.484902 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.484908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.484913 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.485072 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.485815 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.485819 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.485935 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.486061 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.486252 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":43,"spinlock_wait_cycles":896}
I20260807 06:20:03.487602 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.472730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54002 (local address 127.26.252.126:44205)
0807 06:20:03.472877 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.472882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.473793 (+ 911us) server_negotiation.cc:407] Connection header received
0807 06:20:03.475378 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.475383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.475439 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.475548 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.476631 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.477398 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.478623 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.478999 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.479162 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.482685 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.482688 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.482690 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.482712 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.484296 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.484844 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.484847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.484849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.484934 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.485323 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.485326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.485328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.485695 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.485817 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.487309 (+ 1492us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.487449 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":52,"spinlock_wait_cycles":20224}
I20260807 06:20:03.488097 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.474332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55846 (local address 127.26.252.125:45561)
0807 06:20:03.474699 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.474712 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.474756 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:20:03.475143 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.475173 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.475405 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.475593 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.476032 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.477325 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.478315 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.478907 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.479080 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.481751 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.481756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.481766 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.481788 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.484098 (+ 2310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.484611 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.484620 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.484625 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.484776 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.485194 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.485197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.485199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.485690 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.485829 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.486166 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.486515 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":271,"thread_start_us":182,"threads_started":1}
I20260807 06:20:03.488279 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.473135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44205 (local address 127.0.0.1:54002)
0807 06:20:03.473612 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.473696 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.475143 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.475743 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.475751 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.476211 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.476458 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.476473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.477538 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.477540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.478464 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.478476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.479155 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.479159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.479282 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.479902 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.479947 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.482478 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.484432 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.484444 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.484454 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.484731 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.485028 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.485031 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.485033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.485199 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.485893 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.485898 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.486013 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.487818 (+ 1805us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.488019 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":108,"thread_start_us":150,"threads_started":1}
I20260807 06:20:03.489588 13882 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.490581 13777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.491348 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.491051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55652)
0807 06:20:03.491219 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.491281 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 06:20:03.492110 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.491852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55664)
0807 06:20:03.491973 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.492034 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 06:20:03.492237 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:20:03.498612 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.490339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.26.252.125:45561)
0807 06:20:03.490481 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.490486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.490499 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:20:03.490529 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.490532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.490578 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.490668 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.491196 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.491954 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.492914 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.493208 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.493301 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.495385 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.495389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.495391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.495416 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.496913 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.497371 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.497374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.497375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.497452 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.497768 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.497771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.497772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.497938 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.498017 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.498343 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.498497 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:20:03.498716 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.490180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55858)
0807 06:20:03.490280 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.490296 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.490378 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.490679 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.490682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.490890 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.491031 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.491039 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.492058 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.492061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.492796 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.492806 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.493338 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.493341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.493433 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.493951 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.493974 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.495249 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.497063 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.497065 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.497067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.497261 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.497574 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.497576 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.497578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.497679 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.498054 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.498056 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.498177 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.498278 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.498378 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
I20260807 06:20:03.499449 13882 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.499809 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:44951
--webserver_interface=127.26.252.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:03.500222 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.499911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55676)
0807 06:20:03.500093 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.500173 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260807 06:20:03.500422 13810 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
I20260807 06:20:03.501837 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.501587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55678)
0807 06:20:03.501696 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.501764 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 06:20:03.502002 13882 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
I20260807 06:20:03.523447 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 1
I20260807 06:20:03.524264 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.523945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55690)
0807 06:20:03.524106 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.524176 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 06:20:03.525014 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.524796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55706)
0807 06:20:03.524902 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.524954 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 06:20:03.525246 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
I20260807 06:20:03.551282 13882 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 1
I20260807 06:20:03.552160 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.551814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55714)
0807 06:20:03.551989 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.552065 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 06:20:03.552958 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.552698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55724)
0807 06:20:03.552832 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.552895 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 06:20:03.553108 13882 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
I20260807 06:20:03.600473 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 2
I20260807 06:20:03.601440 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.601051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55730)
0807 06:20:03.601247 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.601328 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 06:20:03.602363 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.602089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55746)
0807 06:20:03.602221 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.602284 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 06:20:03.602573 13777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
W20260807 06:20:03.614924 13892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:03.615154 13892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:03.615192 13892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:03.619076 13892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:03.619122 13892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:03.619143 13892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:03.619158 13892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:03.619174 13892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:03.621294 13882 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 2
I20260807 06:20:03.622071 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.621764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55756)
0807 06:20:03.621922 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.621986 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 06:20:03.622877 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.622643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55770)
0807 06:20:03.622762 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.622813 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 06:20:03.623059 13882 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:44951: Network error: Client connection negotiation failed: client connection to 127.26.252.124:44951: connect: Connection refused (error 111)
I20260807 06:20:03.624765 13892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44205,127.26.252.125:45561,127.26.252.124:44951
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:44951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.252.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:03.625788 13892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:03.626866 13892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:03.635221 13901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:03.635313 13892 server_base.cc:1034] running on GCE node
W20260807 06:20:03.635243 13900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:03.635257 13903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:03.636032 13892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:03.637156 13892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:03.638362 13892 hybrid_clock.cc:648] HybridClock initialized: now 1786083603638332 us; error 41 us; skew 500 ppm
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:03.641129 13892 init.cc:377] Logged in from keytab as kudu/127.26.252.124@KRBTEST.COM (short username kudu)
I20260807 06:20:03.641992 13892 webserver.cc:460] Webserver started at http://127.26.252.124:32801/ using document root <none> and password file <none>
I20260807 06:20:03.642618 13892 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:03.642721 13892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:03.642952 13892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:03.644946 13892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data/instance:
uuid: "b70680406130494d90b8a223d2ef9d22"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "6a6af7d730063d5b5029bbb3c06792a6"
server_key_iv: "1e19af92c18ee56d3439ef685e8ffadb"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.645534 13892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal/instance:
uuid: "b70680406130494d90b8a223d2ef9d22"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "6a6af7d730063d5b5029bbb3c06792a6"
server_key_iv: "1e19af92c18ee56d3439ef685e8ffadb"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.649204 13892 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:20:03.651726 13912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:03.652928 13892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:20:03.653070 13892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "b70680406130494d90b8a223d2ef9d22"
format_stamp: "Formatted at 2026-08-07 06:20:03 on dist-test-slave-68xk"
server_key: "6a6af7d730063d5b5029bbb3c06792a6"
server_key_iv: "1e19af92c18ee56d3439ef685e8ffadb"
server_key_version: "encryptionkey@0"
I20260807 06:20:03.653204 13892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:03.683362 13892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:03.686327 13892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:03.686559 13892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:03.693667 13892 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.124:44951
I20260807 06:20:03.693957 13988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.124:44951 every 8 connection(s)
I20260807 06:20:03.694711 13892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
I20260807 06:20:03.697216 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 13892
I20260807 06:20:03.697383 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786083434177398-27633-0/minicluster-data/master-2/wal/instance
I20260807 06:20:03.697680 13989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:03.697710 27633 external_mini_cluster.cc:1428] Setting key 4040ddfd1a2c17717a039199ea4db88c
I20260807 06:20:03.701850 13777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 3
I20260807 06:20:03.703001 13989 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:03.713622 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.702332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55790)
0807 06:20:03.702517 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.702535 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.702631 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.702977 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.702980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.703177 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.703305 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.703312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.704367 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.704371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.705246 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.705259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.705971 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.705975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.706066 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.706702 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.706720 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.708997 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.711453 (+ 2456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.711457 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.711459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.711666 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.712101 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.712105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.712107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.712221 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.713019 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.713024 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.713133 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.713231 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.713390 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 06:20:03.714277 13882 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } attempt: 3
I20260807 06:20:03.714869 13993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.699099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.26.252.124:44951)
0807 06:20:03.699539 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.699554 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.699589 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:20:03.700558 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.700579 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.700985 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.701346 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.702389 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.703966 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.705073 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.705861 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.706366 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.709216 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.709220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.709223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.709253 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.711612 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.712146 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.712149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.712150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.712217 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.712508 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.712555 (+ 47us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.712556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.712856 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.713063 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.713359 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.713659 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":304,"spinlock_wait_cycles":1280,"thread_start_us":144,"threads_started":1}
I20260807 06:20:03.714874 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.702383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55790 (local address 127.26.252.124:44951)
0807 06:20:03.702727 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.702737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.702752 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:20:03.702787 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.702790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.702832 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.702931 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.703451 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.704249 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.705393 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.705829 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.706019 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.709185 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.709192 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.709204 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.709236 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.711329 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.711821 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.711828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.711834 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.711978 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.712359 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.712363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.712365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.712873 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.713956 (+ 1083us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.714070 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.714199 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":270,"spinlock_wait_cycles":3456,"thread_start_us":94,"threads_started":1}
I20260807 06:20:03.717072 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.704927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54018 (local address 127.26.252.126:44205)
0807 06:20:03.705063 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.705068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.705418 (+ 350us) server_negotiation.cc:407] Connection header received
0807 06:20:03.705605 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.705608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.705650 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.705698 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.706737 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.707390 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.708568 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.708992 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.709110 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.713081 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.713085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.713089 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.713111 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.714846 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.715439 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.715443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.715446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.715538 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.715940 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.715947 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.715949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.716246 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.716330 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.716801 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.716917 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:20:03.717581 13995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.704877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:44205 (local address 127.0.0.1:54018)
0807 06:20:03.705300 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.705346 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.705501 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.705901 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.705910 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.706390 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.706585 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.706592 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.707527 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.707534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.708447 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.708458 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.709316 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.709321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.709468 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.710232 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.710254 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.712930 (+ 2676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.714987 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.714995 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.715000 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.715306 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.715685 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.715691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.715693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.715795 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.716420 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.716428 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.716545 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.717194 (+ 649us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.717400 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":168,"threads_started":1}
I20260807 06:20:03.719619 13989 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.719897 13777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: Bootstrap starting.
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:20:03.723583 13777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:03.724476 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.715206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55806)
0807 06:20:03.715510 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.715526 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.715613 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.715885 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.715890 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.716093 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.716212 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.716219 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.717314 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.717317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.718149 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.718159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.718791 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.718795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.718886 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.719383 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.719399 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.720848 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.722927 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.722931 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.722933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.723159 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.723464 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.723468 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.723470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.723559 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.723968 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.723974 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.724068 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.724178 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.724312 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260807 06:20:03.724476 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.715484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55806 (local address 127.26.252.124:44951)
0807 06:20:03.715583 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.715587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.715600 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:20:03.715708 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.715711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.715754 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.715836 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.716364 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.717168 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.718275 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.718618 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.718778 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.721002 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.721005 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.721008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.721032 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.722785 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.723271 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.723275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.723277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.723365 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.723673 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.723677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.723679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.723847 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.723955 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.724231 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.724344 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:20:03.725543 13777 log.cc:824] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:03.727653 13882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: Bootstrap starting.
I20260807 06:20:03.727945 13777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: No bootstrap required, opened a new log
I20260807 06:20:03.730381 13882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:03.730485 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.717902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54034 (local address 127.26.252.126:44205)
0807 06:20:03.718011 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.718015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.718597 (+ 582us) server_negotiation.cc:407] Connection header received
0807 06:20:03.718635 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.718638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.718678 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.718763 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.720680 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.721307 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.722327 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.723084 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.723208 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.726349 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.726355 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.726360 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.726391 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.728347 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.728883 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.728887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.728889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.728977 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.729298 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.729303 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.729304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.729535 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.729696 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.730103 (+ 407us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.730230 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 06:20:03.731302 13882 log.cc:824] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:20:03.732746 13777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.733057 13777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:03.733157 13777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9df6a03b08ac4f16a9fecad79e6c7321, State: Initialized, Role: FOLLOWER
I20260807 06:20:03.733590 13882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: No bootstrap required, opened a new log
I20260807 06:20:03.733843 13777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.735385 13777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:03.736413 13888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.722580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.26.252.125:45561)
0807 06:20:03.722689 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.722694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.722716 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:20:03.722746 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.722748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.722781 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.722881 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.726570 (+ 3689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.728112 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.729426 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.729786 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.729864 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.732473 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.732480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.732486 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.732517 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.734441 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.734976 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.734980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.734982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.735066 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.735400 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.735406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.735412 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.735677 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.735754 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.736139 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.736253 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:20:03.736934 13995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.720118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:45561 (local address 127.0.0.1:55864)
0807 06:20:03.720759 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.720774 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.720843 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.726066 (+ 5223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.726071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.726273 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.726400 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.726429 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.728295 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.728300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.729286 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.729297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.730034 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.730039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.730168 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.730724 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.730741 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.732313 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.734582 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.734585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.734588 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.734853 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.735203 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.735206 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.735209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.735296 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.735840 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.735843 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.735939 (+ 96us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.736601 (+ 662us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.736750 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568}
I20260807 06:20:03.737876 13882 raft_consensus.cc:348] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.738076 13882 raft_consensus.cc:374] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:03.738135 13882 raft_consensus.cc:729] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c204479baf984bb6aa20dc17112b9c10, State: Initialized, Role: FOLLOWER
I20260807 06:20:03.738299 13989 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:20:03.738653 13882 consensus_queue.cc:260] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:20:03.739542 14001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.739681 14001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.740121 13882 sys_catalog.cc:564] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:03.745023 13999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.732398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55880 (local address 127.26.252.125:45561)
0807 06:20:03.733186 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.733195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.733211 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:20:03.733248 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.733251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.733306 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.734339 (+ 1033us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.734481 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.735381 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.736524 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.736896 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.737389 (+ 493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.740288 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.740294 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.740299 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.740329 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.742146 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.742769 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.742773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.742775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.742870 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.743224 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.743228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.743229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.743479 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.744357 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.744441 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.744563 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":93,"threads_started":1}
Aug 07 06:20:03 dist-test-slave-68xk krb5kdc[13656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:20:03.748104 14013 sys_catalog.cc:455] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.748296 14013 sys_catalog.cc:458] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.750166 13995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.738794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:44951 (local address 127.0.0.1:55808)
0807 06:20:03.739698 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:03.739714 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:03.739834 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:03.740204 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:03.740207 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:03.740401 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:03.740508 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.740517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.742038 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.742042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.742968 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:03.742980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.743597 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.743600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:03.743670 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.744135 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:03.744150 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:03.745574 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:03.748569 (+ 2995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.748574 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.748576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.748857 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.749193 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:03.749196 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:03.749198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:03.749304 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:03.749706 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:03.749708 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:03.749779 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 06:20:03.749879 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 06:20:03.750009 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 06:20:03.750701 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.738940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55808 (local address 127.26.252.124:44951)
0807 06:20:03.739043 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.739047 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.739769 (+ 722us) server_negotiation.cc:407] Connection header received
0807 06:20:03.739941 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.739944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.739989 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.740039 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.740886 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.741914 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.743095 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.743393 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.743470 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.745704 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.745707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.745710 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.745745 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.747447 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.748974 (+ 1527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.748977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.748978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.749054 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.749399 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.749402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.749404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.749585 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.749655 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.750452 (+ 797us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.750560 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 06:20:03.746598 13679 master_runner.cc:186] Error getting master registration for 127.26.252.124:44951: OK, instance_id { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" instance_seqno: 1786083603691738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:20:03.751024 13679 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 06:20:03.752208 14017 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:20:03.752576 14017 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:20:03.749184 13786 master_runner.cc:186] Error getting master registration for 127.26.252.124:44951: OK, instance_id { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" instance_seqno: 1786083603691738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:20:03.752934 13786 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:20:03.753623 13989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: Bootstrap starting.
W20260807 06:20:03.753923 14030 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:20:03.753984 14030 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:20:03.754365 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:20:03.756546 13989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:03.757567 13989 log.cc:824] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:03.759846 14013 raft_consensus.cc:482] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:03.759984 14013 raft_consensus.cc:504] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.760111 13989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: No bootstrap required, opened a new log
I20260807 06:20:03.760963 14013 leader_election.cc:288] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9df6a03b08ac4f16a9fecad79e6c7321 (127.26.252.126:44205), b70680406130494d90b8a223d2ef9d22 (127.26.252.124:44951)
I20260807 06:20:03.761369 13729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c204479baf984bb6aa20dc17112b9c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" is_pre_election: true
I20260807 06:20:03.761669 13729 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c204479baf984bb6aa20dc17112b9c10 in term 0.
I20260807 06:20:03.762403 13809 leader_election.cc:302] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9df6a03b08ac4f16a9fecad79e6c7321, c204479baf984bb6aa20dc17112b9c10; no voters:
I20260807 06:20:03.762812 14013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:03.762907 14013 raft_consensus.cc:482] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:03.762959 14013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:03.764343 14013 raft_consensus.cc:504] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.764619 13989 raft_consensus.cc:348] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.764916 13989 raft_consensus.cc:374] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:03.765033 13989 raft_consensus.cc:729] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b70680406130494d90b8a223d2ef9d22, State: Initialized, Role: FOLLOWER
I20260807 06:20:03.765588 13729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c204479baf984bb6aa20dc17112b9c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9df6a03b08ac4f16a9fecad79e6c7321"
I20260807 06:20:03.765615 13989 consensus_queue.cc:260] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.765746 13729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:03.767076 13989 sys_catalog.cc:564] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:03.767185 13729 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c204479baf984bb6aa20dc17112b9c10 in term 1.
I20260807 06:20:03.767382 13946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c204479baf984bb6aa20dc17112b9c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70680406130494d90b8a223d2ef9d22"
I20260807 06:20:03.767624 13946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:03.769186 13946 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c204479baf984bb6aa20dc17112b9c10 in term 1.
I20260807 06:20:03.769619 13810 leader_election.cc:302] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b70680406130494d90b8a223d2ef9d22, c204479baf984bb6aa20dc17112b9c10; no voters:
I20260807 06:20:03.770220 13948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c204479baf984bb6aa20dc17112b9c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b70680406130494d90b8a223d2ef9d22" is_pre_election: true
I20260807 06:20:03.770365 13948 raft_consensus.cc:2362] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c204479baf984bb6aa20dc17112b9c10 in term 1. Re-sending same reply.
I20260807 06:20:03.771170 14013 leader_election.cc:288] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [CANDIDATE]: Term 1 election: Requested vote from peers 9df6a03b08ac4f16a9fecad79e6c7321 (127.26.252.126:44205), b70680406130494d90b8a223d2ef9d22 (127.26.252.124:44951)
I20260807 06:20:03.771327 14013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:03.771432 14013 raft_consensus.cc:686] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [term 1 LEADER]: Becoming Leader. State: Replica: c204479baf984bb6aa20dc17112b9c10, State: Running, Role: LEADER
I20260807 06:20:03.771719 14013 consensus_queue.cc:237] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } }
I20260807 06:20:03.773267 14013 sys_catalog.cc:455] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c204479baf984bb6aa20dc17112b9c10. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.773379 14013 sys_catalog.cc:458] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:03.774914 14066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:03.776579 14066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 06:20:03.787985 14057 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:20:03.788084 14057 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:20:03.793424 13999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.770929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55886 (local address 127.26.252.125:45561)
0807 06:20:03.771041 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.771045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.780219 (+ 9174us) server_negotiation.cc:407] Connection header received
0807 06:20:03.780414 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.780418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.780468 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.780527 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.781439 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.782329 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.783598 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.784005 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.784082 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.789299 (+ 5217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.789305 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.789310 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.789338 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.791170 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.791783 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.791788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.791790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.791884 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.792229 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.792234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.792238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.792489 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.792661 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.793076 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.793218 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:20:03.794042 14038 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.794198 14038 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.797043 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.770047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54050 (local address 127.26.252.126:44205)
0807 06:20:03.770172 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.770178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.778874 (+ 8696us) server_negotiation.cc:407] Connection header received
0807 06:20:03.779001 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.779006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.779063 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.779157 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.780611 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.781521 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.785374 (+ 3853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.785712 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.785796 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.788782 (+ 2986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.788787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.788792 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.788834 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.790859 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.792402 (+ 1543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.792406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.792408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.792496 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.794612 (+ 2116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.794619 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.794623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.794873 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.795016 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.796438 (+ 1422us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.796692 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:20:03.798156 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:03.770047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55816 (local address 127.26.252.124:44951)
0807 06:20:03.770164 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:03.770170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:03.779236 (+ 9066us) server_negotiation.cc:407] Connection header received
0807 06:20:03.779428 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:03.779431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:03.779488 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:03.779551 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:03.783391 (+ 3840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.784200 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.786460 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:03.786877 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:03.786959 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:03.792025 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:03.792029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:03.792032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:03.792078 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:03.793951 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.795375 (+ 1424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.795379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.795381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.795482 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:03.795843 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:03.795848 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:03.795850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:03.796077 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:03.797488 (+ 1411us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:03.797878 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 06:20:03.798008 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:20:03.807129 13948 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [term 1 FOLLOWER]: Refusing update from remote peer c204479baf984bb6aa20dc17112b9c10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:03.807200 13729 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [term 1 FOLLOWER]: Refusing update from remote peer c204479baf984bb6aa20dc17112b9c10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:03.807853 14013 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:03.808310 14013 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:03.812561 14001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c204479baf984bb6aa20dc17112b9c10. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.812690 14001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.817512 14038 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c204479baf984bb6aa20dc17112b9c10. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.817637 14038 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.825443 14058 sys_catalog.cc:455] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.825582 14058 sys_catalog.cc:458] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:03.825711 14067 mvcc.cc:205] Tried to move back new op lower bound from 7315798441182797824 to 7315798441051639808. Current Snapshot: MvccSnapshot[applied={T|T < 7315798441182797824}]
I20260807 06:20:03.828193 14001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.828321 14001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.829770 14013 sys_catalog.cc:455] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.829895 14013 sys_catalog.cc:458] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:03.830813 14038 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c204479baf984bb6aa20dc17112b9c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9df6a03b08ac4f16a9fecad79e6c7321" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44205 } } peers { permanent_uuid: "c204479baf984bb6aa20dc17112b9c10" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 45561 } } peers { permanent_uuid: "b70680406130494d90b8a223d2ef9d22" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 44951 } } }
I20260807 06:20:03.830931 14038 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:20:03.831936 14073 mvcc.cc:205] Tried to move back new op lower bound from 7315798441182797824 to 7315798441051639808. Current Snapshot: MvccSnapshot[applied={T|T < 7315798441182797824}]
I20260807 06:20:03.832111 14070 mvcc.cc:205] Tried to move back new op lower bound from 7315798441182797824 to 7315798441051639808. Current Snapshot: MvccSnapshot[applied={T|T < 7315798441182797824}]
I20260807 06:20:03.837252 14066 catalog_manager.cc:1347] Generated new cluster ID: 4b8fcede47794a01a1aa728395b2f98b
I20260807 06:20:03.837320 14066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:03.857878 14066 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:20:03.859174 14066 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:03.882479 14066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c204479baf984bb6aa20dc17112b9c10: Generated new TSK 0
I20260807 06:20:03.883437 14066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:20:04.754172 14017 catalog_manager.cc:1259] Loaded cluster ID: 4b8fcede47794a01a1aa728395b2f98b
I20260807 06:20:04.754293 14017 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: loading cluster ID for follower catalog manager: success
I20260807 06:20:04.756220 14017 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: acquiring CA information for follower catalog manager: success
I20260807 06:20:04.757499 14017 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9df6a03b08ac4f16a9fecad79e6c7321: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:20:04.789606 14057 catalog_manager.cc:1259] Loaded cluster ID: 4b8fcede47794a01a1aa728395b2f98b
I20260807 06:20:04.789688 14057 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: loading cluster ID for follower catalog manager: success
I20260807 06:20:04.791363 14057 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: acquiring CA information for follower catalog manager: success
I20260807 06:20:04.792464 14057 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b70680406130494d90b8a223d2ef9d22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:20:04.952247 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 13679
I20260807 06:20:04.965373 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 13786
I20260807 06:20:04.976150 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 13892
2026-08-07T06:20:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3307 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:20:05 dist-test-slave-68xk krb5kdc[14086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:20:05 dist-test-slave-68xk krb5kdc[14086](info): set up 2 sockets
Aug 07 06:20:05 dist-test-slave-68xk krb5kdc[14086](info): commencing operation
krb5kdc: starting...
W20260807 06:20:06.250913 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:20:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:20:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:20:06.389281 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44507
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:44507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:06.511356 14105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:06.511670 14105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:06.511752 14105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:06.516062 14105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:06.516149 14105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:06.516188 14105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:06.516256 14105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:06.516309 14105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:06.521667 14105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:44507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:44507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:06.522825 14105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:06.523878 14105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:06.532667 14115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:06.532670 14111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:06.532933 14112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:06.533042 14105 server_base.cc:1034] running on GCE node
I20260807 06:20:06.533601 14105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:06.534772 14105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:06.535961 14105 hybrid_clock.cc:648] HybridClock initialized: now 1786083606535950 us; error 28 us; skew 500 ppm
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083606, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:06.539008 14105 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:06.539925 14105 webserver.cc:460] Webserver started at http://127.26.252.126:45517/ using document root <none> and password file <none>
I20260807 06:20:06.540524 14105 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:06.540621 14105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:06.540872 14105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:06.543099 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "bde37ef7613d41b8957a3a53544e09f8"
format_stamp: "Formatted at 2026-08-07 06:20:06 on dist-test-slave-68xk"
server_key: "be28b2b1990ad0f86dcf5b64f3944827"
server_key_iv: "7c99e240145cdc33ad86f156e2fa3d5c"
server_key_version: "encryptionkey@0"
I20260807 06:20:06.543694 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "bde37ef7613d41b8957a3a53544e09f8"
format_stamp: "Formatted at 2026-08-07 06:20:06 on dist-test-slave-68xk"
server_key: "be28b2b1990ad0f86dcf5b64f3944827"
server_key_iv: "7c99e240145cdc33ad86f156e2fa3d5c"
server_key_version: "encryptionkey@0"
I20260807 06:20:06.547756 14105 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:06.550678 14128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:06.552160 14105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:06.552345 14105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "bde37ef7613d41b8957a3a53544e09f8"
format_stamp: "Formatted at 2026-08-07 06:20:06 on dist-test-slave-68xk"
server_key: "be28b2b1990ad0f86dcf5b64f3944827"
server_key_iv: "7c99e240145cdc33ad86f156e2fa3d5c"
server_key_version: "encryptionkey@0"
I20260807 06:20:06.552489 14105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:06.584362 14105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:06.588121 14105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:06.588356 14105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:06.595739 14105 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:44507
I20260807 06:20:06.595834 14202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:44507 every 8 connection(s)
I20260807 06:20:06.596798 14105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:06.599768 14203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:06.606086 14203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8: Bootstrap starting.
I20260807 06:20:06.606819 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 14105
I20260807 06:20:06.606956 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:20:06.607236 27633 external_mini_cluster.cc:1428] Setting key 9402989bb320fad247e5714ed9be620d
I20260807 06:20:06.609165 14203 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:06.609987 14203 log.cc:824] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:06.612469 14203 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8: No bootstrap required, opened a new log
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:06.617131 14203 raft_consensus.cc:348] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } }
I20260807 06:20:06.617447 14203 raft_consensus.cc:374] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:06.617540 14203 raft_consensus.cc:729] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bde37ef7613d41b8957a3a53544e09f8, State: Initialized, Role: FOLLOWER
I20260807 06:20:06.618065 14203 consensus_queue.cc:260] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } }
I20260807 06:20:06.618265 14203 raft_consensus.cc:388] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:06.618343 14203 raft_consensus.cc:482] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:06.618465 14203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:06.619750 14203 raft_consensus.cc:504] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } }
I20260807 06:20:06.620126 14203 leader_election.cc:302] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bde37ef7613d41b8957a3a53544e09f8; no voters:
I20260807 06:20:06.620529 14203 leader_election.cc:288] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:20:06.620596 14208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:06.620813 14208 raft_consensus.cc:686] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [term 1 LEADER]: Becoming Leader. State: Replica: bde37ef7613d41b8957a3a53544e09f8, State: Running, Role: LEADER
I20260807 06:20:06.621110 14208 consensus_queue.cc:237] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } }
I20260807 06:20:06.621863 14203 sys_catalog.cc:564] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:06.622308 14208 sys_catalog.cc:455] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bde37ef7613d41b8957a3a53544e09f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } } }
I20260807 06:20:06.622438 14208 sys_catalog.cc:458] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:06.622992 14213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:06.623582 14206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:06.608697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.26.252.126:44507)
0807 06:20:06.609139 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:06.609173 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:06.609212 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:20:06.609992 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:06.610011 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:06.610545 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:06.610975 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:06.611932 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:06.613008 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:06.614220 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:06.614798 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:06.614918 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:06.617900 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:06.617906 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:06.617923 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:06.617953 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:06.620311 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:06.620821 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:06.620829 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:06.620836 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:06.620983 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:06.621305 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:06.621309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:06.621310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:06.621699 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:06.621943 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:06.622205 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 06:20:06.622572 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":147,"threads_started":1}
I20260807 06:20:06.624574 14211 sys_catalog.cc:455] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bde37ef7613d41b8957a3a53544e09f8. Latest consensus state: current_term: 1 leader_uuid: "bde37ef7613d41b8957a3a53544e09f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bde37ef7613d41b8957a3a53544e09f8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 44507 } } }
I20260807 06:20:06.624670 14211 sys_catalog.cc:458] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:06.626667 14213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:06.626991 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:20:06.632558 14213 catalog_manager.cc:1347] Generated new cluster ID: 9db0d9b815904d91bfd9d92c3d45615a
I20260807 06:20:06.632627 14213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:06.648566 14213 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:20:06.649814 14213 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:06.656250 14213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bde37ef7613d41b8957a3a53544e09f8: Generated new TSK 0
I20260807 06:20:06.657037 14213 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:20:06.683082 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 14105
2026-08-07T06:20:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1701 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14241](info): set up 2 sockets
Aug 07 06:20:06 dist-test-slave-68xk krb5kdc[14241](info): commencing operation
krb5kdc: starting...
W20260807 06:20:07.966850 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:20:08.103585 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:08.216766 14259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:08.217015 14259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:08.217056 14259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:08.220920 14259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:08.220969 14259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:08.220989 14259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:08.221005 14259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:08.221020 14259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:08.226274 14259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:08.227296 14259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:08.228241 14259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:08.236871 14266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.236877 14269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:08.237076 14259 server_base.cc:1034] running on GCE node
W20260807 06:20:08.236893 14267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:08.237687 14259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:08.238862 14259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:08.240046 14259 hybrid_clock.cc:648] HybridClock initialized: now 1786083608240013 us; error 43 us; skew 500 ppm
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:08.242789 14259 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:08.243680 14259 webserver.cc:460] Webserver started at http://127.26.252.126:45807/ using document root <none> and password file <none>
I20260807 06:20:08.244234 14259 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:08.244330 14259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:08.244565 14259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:08.246663 14259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "f732bf3f97e841668f94794ad79ceba0"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "91d798126b64634cae00cb775a802040"
server_key_iv: "172f50fa742e306c62ddd3e449586a57"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.247236 14259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "f732bf3f97e841668f94794ad79ceba0"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "91d798126b64634cae00cb775a802040"
server_key_iv: "172f50fa742e306c62ddd3e449586a57"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.250927 14259 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:20:08.253227 14277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.254505 14259 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:20:08.254645 14259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "f732bf3f97e841668f94794ad79ceba0"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "91d798126b64634cae00cb775a802040"
server_key_iv: "172f50fa742e306c62ddd3e449586a57"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.254766 14259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:08.277030 14259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:08.279939 14259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:08.280145 14259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:08.287292 14259 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34675
I20260807 06:20:08.287565 14356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34675 every 8 connection(s)
I20260807 06:20:08.288264 14259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:08.290452 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 14259
I20260807 06:20:08.290580 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:20:08.290901 27633 external_mini_cluster.cc:1428] Setting key bbfdb238414e4966842ae15d70aa0a6a
I20260807 06:20:08.291301 14358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:08.298374 14358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap starting.
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:08.301244 14358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:08.302167 14358 log.cc:824] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:08.304562 14358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: No bootstrap required, opened a new log
I20260807 06:20:08.305899 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:08.292387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45512 (local address 127.26.252.126:34675)
0807 06:20:08.292793 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:08.292821 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:08.292856 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:20:08.293495 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:08.293511 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:08.293819 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:08.294084 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:08.295047 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.296053 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.297261 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.297706 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.297816 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:08.300686 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:08.300692 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:08.300707 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:08.300739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:08.302767 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.303264 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.303270 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.303276 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.303412 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.303680 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.303683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.303684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.304182 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:08.304386 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:08.304652 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 06:20:08.304957 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":135,"threads_started":1}
I20260807 06:20:08.308454 14358 raft_consensus.cc:348] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:08.308665 14358 raft_consensus.cc:374] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:08.308707 14358 raft_consensus.cc:729] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Initialized, Role: FOLLOWER
I20260807 06:20:08.309067 14358 consensus_queue.cc:260] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:08.309180 14358 raft_consensus.cc:388] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:08.309223 14358 raft_consensus.cc:482] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:08.309297 14358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:08.310135 14358 raft_consensus.cc:504] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:08.310493 14358 leader_election.cc:302] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f732bf3f97e841668f94794ad79ceba0; no voters:
I20260807 06:20:08.310781 14358 leader_election.cc:288] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:20:08.310899 14365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:08.311192 14365 raft_consensus.cc:686] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 LEADER]: Becoming Leader. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Running, Role: LEADER
I20260807 06:20:08.311507 14365 consensus_queue.cc:237] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:08.312045 14358 sys_catalog.cc:564] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:08.313202 14366 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:08.313367 14366 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:08.313215 14367 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f732bf3f97e841668f94794ad79ceba0. Latest consensus state: current_term: 1 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:08.313814 14367 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:08.315045 14376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:08.317611 14376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:08.322863 14376 catalog_manager.cc:1347] Generated new cluster ID: 2d87549667b246cbb8b2e800d610c083
I20260807 06:20:08.322932 14376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:08.344321 14376 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:20:08.345589 14376 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:08.357427 14376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Generated new TSK 0
I20260807 06:20:08.358244 14376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:20:08.393630 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:08.509941 14390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:08.510193 14390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:08.510236 14390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:08.514433 14390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:08.514485 14390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:08.514570 14390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:20:08.519721 14390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:08.520799 14390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:08.521822 14390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:08.531302 14397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.531304 14400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.531276 14398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:08.532116 14390 server_base.cc:1034] running on GCE node
I20260807 06:20:08.532472 14390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:08.533017 14390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:08.534183 14390 hybrid_clock.cc:648] HybridClock initialized: now 1786083608534163 us; error 29 us; skew 500 ppm
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:08.536923 14390 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:20:08.537752 14390 webserver.cc:460] Webserver started at http://127.26.252.65:34181/ using document root <none> and password file <none>
I20260807 06:20:08.538311 14390 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:08.538403 14390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:08.538651 14390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:08.540675 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "0c9c5ffbc19941938468c93b3419b1a7"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "e10f7e2590ac34bcba9f158c1e0d837a"
server_key_iv: "b10da79688d98a7ac3bb68b2601bff01"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.541271 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "0c9c5ffbc19941938468c93b3419b1a7"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "e10f7e2590ac34bcba9f158c1e0d837a"
server_key_iv: "b10da79688d98a7ac3bb68b2601bff01"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.545169 14390 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 06:20:08.547761 14410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.548982 14390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:20:08.549113 14390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0c9c5ffbc19941938468c93b3419b1a7"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "e10f7e2590ac34bcba9f158c1e0d837a"
server_key_iv: "b10da79688d98a7ac3bb68b2601bff01"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.549219 14390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:08.562276 14390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:08.565541 14390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:08.565752 14390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:08.566362 14390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:08.567219 14390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:08.567294 14390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.567365 14390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:08.567420 14390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.576618 14390 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:33165
I20260807 06:20:08.576666 14569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:33165 every 8 connection(s)
I20260807 06:20:08.577572 14390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:20:08.581099 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 14390
I20260807 06:20:08.581252 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:20:08.581544 27633 external_mini_cluster.cc:1428] Setting key cb25540fba861e9690b53fa63427a950
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:20:08.593502 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:08.579472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:41647 (local address 127.26.252.126:34675)
0807 06:20:08.579670 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:08.579674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:08.580457 (+ 783us) server_negotiation.cc:407] Connection header received
0807 06:20:08.582020 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:08.582023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:08.582089 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:08.582202 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:08.583614 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.584169 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.585832 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.586289 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.586444 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:08.589428 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:08.589431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:08.589433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:08.589459 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:08.590974 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.591637 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.591639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.591641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.591718 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.592180 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.592183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.592184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.592385 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:08.592648 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:08.593214 (+ 566us) server_negotiation.cc:299] Negotiation successful
0807 06:20:08.593344 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 06:20:08.594355 14575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:08.579839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:41647)
0807 06:20:08.580292 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:08.580334 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:08.581819 (+ 1485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:08.582396 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:08.582403 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:08.582818 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:08.583437 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:08.583459 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.584313 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.584319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:08.585685 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:08.585696 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.586515 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.586519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:08.586663 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:08.587289 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:08.587305 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:08.589228 (+ 1923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:08.591113 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:08.591120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:08.591138 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:08.591522 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:08.591831 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:08.591835 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:08.591837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:08.592042 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:08.592613 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:08.592621 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:08.592967 (+ 346us) client_negotiation.cc:769] Sending connection context
0807 06:20:08.593156 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 06:20:08.593421 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:20:08.595832 14572 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:08.596128 14572 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:08.596663 14572 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:08.598299 14300 ts_manager.cc:194] Registered new tserver with Master: 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165)
I20260807 06:20:08.599606 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:41647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:20:08.614135 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:08.727900 14580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:08.728186 14580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:08.728271 14580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:08.732344 14580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:08.732435 14580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:08.732530 14580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:20:08.737787 14580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:08.738933 14580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:08.739988 14580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:08.750077 14590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.750025 14593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.750036 14589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:08.750119 14580 server_base.cc:1034] running on GCE node
I20260807 06:20:08.750695 14580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:08.751350 14580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:08.752518 14580 hybrid_clock.cc:648] HybridClock initialized: now 1786083608752489 us; error 39 us; skew 500 ppm
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:08.755566 14580 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:20:08.756376 14580 webserver.cc:460] Webserver started at http://127.26.252.66:38377/ using document root <none> and password file <none>
I20260807 06:20:08.756904 14580 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:08.756963 14580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:08.757128 14580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:08.759307 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "8e5612e1777e419792829d4252fa2e3a"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "9c7ceff79dd4e0744ada1baae2b3b8b0"
server_key_iv: "fd1e6c63c826bb597e6345d0ad39b894"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.759815 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "8e5612e1777e419792829d4252fa2e3a"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "9c7ceff79dd4e0744ada1baae2b3b8b0"
server_key_iv: "fd1e6c63c826bb597e6345d0ad39b894"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.763610 14580 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:08.766196 14600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.767527 14580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:20:08.767705 14580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "8e5612e1777e419792829d4252fa2e3a"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "9c7ceff79dd4e0744ada1baae2b3b8b0"
server_key_iv: "fd1e6c63c826bb597e6345d0ad39b894"
server_key_version: "encryptionkey@0"
I20260807 06:20:08.767818 14580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:08.800927 14580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:08.804814 14580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:08.805119 14580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:08.805814 14580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:08.806821 14580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:08.806902 14580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.806998 14580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:08.807056 14580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:08.817984 14580 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35993
I20260807 06:20:08.818038 14749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35993 every 8 connection(s)
I20260807 06:20:08.819065 14580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:20:08.821429 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 14580
I20260807 06:20:08.821583 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:20:08.821906 27633 external_mini_cluster.cc:1428] Setting key b656c5ddb7feca5e60f03180c899929a
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:20:08.835290 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:08.821129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:49715 (local address 127.26.252.126:34675)
0807 06:20:08.821306 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:08.821312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:08.822375 (+ 1063us) server_negotiation.cc:407] Connection header received
0807 06:20:08.824325 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:08.824328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:08.824373 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:08.824452 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:08.826253 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.826898 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.828181 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.828608 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.828745 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:08.831288 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:08.831296 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:08.831301 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:08.831341 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:08.833172 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.833699 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.833704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.833706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.833798 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:08.834157 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:08.834160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:08.834162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:08.834352 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:08.834488 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:08.834981 (+ 493us) server_negotiation.cc:299] Negotiation successful
0807 06:20:08.835102 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:20:08.836107 14753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:08.821632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:49715)
0807 06:20:08.822208 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:08.822270 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:08.824078 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:08.824699 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:08.824712 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:08.825307 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:08.826076 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:08.826104 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.827037 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.827040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:08.828024 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:08.828034 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:08.828778 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:08.828781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:08.828937 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:08.829588 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:08.829605 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:08.831097 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:08.833311 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:08.833315 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:08.833327 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:08.833577 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:08.833903 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:08.833907 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:08.833909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:08.834052 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:08.834488 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:08.834495 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:08.834731 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 06:20:08.834937 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 06:20:08.835255 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":116,"threads_started":1}
I20260807 06:20:08.837433 14751 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:08.837723 14751 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:20:08.838347 14751 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:08.839570 14300 ts_manager.cc:194] Registered new tserver with Master: 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
I20260807 06:20:08.840268 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:49715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:20:08.857700 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:08.973964 14757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:08.974254 14757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:08.974334 14757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:08.978291 14757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:08.978376 14757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:08.978482 14757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:20:08.983636 14757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:08.984663 14757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:08.985684 14757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:08.995255 14768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.995286 14765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:08.995255 14764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:08.995647 14757 server_base.cc:1034] running on GCE node
I20260807 06:20:08.996043 14757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:08.996622 14757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:08.997807 14757 hybrid_clock.cc:648] HybridClock initialized: now 1786083608997771 us; error 47 us; skew 500 ppm
Aug 07 06:20:08 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:09.000902 14757 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:20:09.001827 14757 webserver.cc:460] Webserver started at http://127.26.252.67:43159/ using document root <none> and password file <none>
I20260807 06:20:09.002456 14757 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:09.002542 14757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:09.002792 14757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:09.004913 14757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "9f60bf55c6444faebdc3c8d259ac0580"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "6e0a6c5299f43ebf4c7ca18381471287"
server_key_iv: "05194cd869cb457ca2451e83f7ff2e08"
server_key_version: "encryptionkey@0"
I20260807 06:20:09.005496 14757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "9f60bf55c6444faebdc3c8d259ac0580"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "6e0a6c5299f43ebf4c7ca18381471287"
server_key_iv: "05194cd869cb457ca2451e83f7ff2e08"
server_key_version: "encryptionkey@0"
I20260807 06:20:09.011200 14757 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:20:09.014478 14779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:09.015758 14757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:20:09.015873 14757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "9f60bf55c6444faebdc3c8d259ac0580"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "6e0a6c5299f43ebf4c7ca18381471287"
server_key_iv: "05194cd869cb457ca2451e83f7ff2e08"
server_key_version: "encryptionkey@0"
I20260807 06:20:09.015961 14757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:09.036654 14757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:09.039552 14757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:09.039719 14757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:09.040242 14757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:09.041033 14757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:09.041081 14757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:09.041121 14757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:09.041137 14757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:09.050638 14757 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:46355
I20260807 06:20:09.050663 14938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:46355 every 8 connection(s)
I20260807 06:20:09.051525 14757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:20:09.054755 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 14757
I20260807 06:20:09.054905 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:20:09.055192 27633 external_mini_cluster.cc:1428] Setting key 44204678b3de149566568ba9ab6d38ad
Aug 07 06:20:09 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083608, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:09.065781 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.053462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:41639 (local address 127.26.252.126:34675)
0807 06:20:09.053607 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.053611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.054558 (+ 947us) server_negotiation.cc:407] Connection header received
0807 06:20:09.056144 (+ 1586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.056147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.056208 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.056296 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:09.057705 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.058324 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.059474 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.059684 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.059770 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.062208 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:09.062212 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:09.062214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:09.062240 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:09.063807 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.064377 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.064380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.064381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.064455 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.064785 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.064787 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.064788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.064957 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:09.065034 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.065554 (+ 520us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.065651 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:20:09.066694 14943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.053869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:41639)
0807 06:20:09.054351 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.054394 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.055915 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.056508 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.056515 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.056957 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:09.057577 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.057594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.058472 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.058475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.059368 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.059377 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.059827 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.059830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.059964 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.060515 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:09.060531 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:09.062028 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:09.063927 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:09.063932 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:09.063943 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:09.064280 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:09.064547 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:09.064550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:09.064551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:09.064698 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:09.065071 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:09.065076 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:09.065341 (+ 265us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.065507 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.065765 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":119,"threads_started":1}
I20260807 06:20:09.067917 14939 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:09.068197 14939 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:09.068832 14939 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:09.069984 14300 ts_manager.cc:194] Registered new tserver with Master: 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355)
I20260807 06:20:09.070642 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:41639
I20260807 06:20:09.080984 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:20:09.091111 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.083164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45516 (local address 127.26.252.126:34675)
0807 06:20:09.083314 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.083319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.083540 (+ 221us) server_negotiation.cc:407] Connection header received
0807 06:20:09.083699 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.083702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.083766 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.083857 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:09.084612 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.085149 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.086034 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.086274 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.086385 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.087874 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:09.087878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:09.087880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:09.087906 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:09.089337 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.089785 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.089789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.089790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.089877 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.090160 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.090163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.090165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.090395 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:09.090575 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.090828 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.090952 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:20:09.094105 14300 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45516:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:20:09.097112 14300 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:20:09.112929 14956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.106042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46355 (local address 127.0.0.1:43782)
0807 06:20:09.107194 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.107251 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.107389 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.108297 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.108303 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.108327 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.108485 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.108494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.109819 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.109822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.111125 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.111144 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.112279 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.112283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.112403 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.112449 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.112603 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.112725 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":963,"mutex_wait_us":109,"thread_start_us":136,"threads_started":1}
I20260807 06:20:09.113667 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.106600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.26.252.67:46355)
0807 06:20:09.107728 (+ 1128us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.107744 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.107770 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:20:09.107860 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.107868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.108111 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.108312 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.108633 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.109636 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.111281 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.112121 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.112255 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.112410 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.112622 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.112740 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1002,"thread_start_us":165,"threads_started":1}
I20260807 06:20:09.113716 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.107503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.26.252.66:35993)
0807 06:20:09.107850 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.107863 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.108069 (+ 206us) server_negotiation.cc:407] Connection header received
0807 06:20:09.108182 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.108188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.108352 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.108479 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.108825 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.110002 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.111775 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.112488 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.112594 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.112732 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.113464 (+ 732us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.113568 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":149,"threads_started":1}
I20260807 06:20:09.113991 14957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.107340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.0.0.1:47118)
0807 06:20:09.107962 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.107975 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.108066 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.108509 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.108511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.108534 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.108693 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.108703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.110173 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.110177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.111615 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.111627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.112980 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.112984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.113218 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.113246 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.113324 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.113396 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":117,"spinlock_wait_cycles":896,"thread_start_us":93,"threads_started":1}
I20260807 06:20:09.114725 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.106905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54214 (local address 127.26.252.65:33165)
0807 06:20:09.107899 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.107912 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.107933 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:20:09.107998 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.108001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.108212 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.108368 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.108901 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.110052 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.111772 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.112747 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.112861 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.113018 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.113741 (+ 723us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.114588 (+ 847us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":126,"threads_started":1}
I20260807 06:20:09.115011 14962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.106134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:33165 (local address 127.0.0.1:54214)
0807 06:20:09.107666 (+ 1532us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.107681 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.107788 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.108538 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.108541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.108575 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.108736 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.108742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.110173 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.110177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.111615 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.111627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.113348 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.113352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.113457 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.113482 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.113557 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.113639 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1452,"mutex_wait_us":185,"spinlock_wait_cycles":9984,"thread_start_us":125,"threads_started":1}
I20260807 06:20:09.116794 14667 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (DEFAULT_TABLE table=test-table [id=41e79f555ed141a296c2d059f3184a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:09.116824 14845 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (DEFAULT_TABLE table=test-table [id=41e79f555ed141a296c2d059f3184a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:09.117838 14667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:09.117975 14845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:09.117694 14479 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (DEFAULT_TABLE table=test-table [id=41e79f555ed141a296c2d059f3184a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:09.118749 14479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:09.124020 14965 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Bootstrap starting.
I20260807 06:20:09.125912 14971 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap starting.
I20260807 06:20:09.126951 14965 tablet_bootstrap.cc:654] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:09.126963 14966 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Bootstrap starting.
I20260807 06:20:09.127888 14965 log.cc:824] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:09.128330 14971 tablet_bootstrap.cc:654] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:09.128924 14966 tablet_bootstrap.cc:654] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:09.129063 14971 log.cc:824] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:09.130354 14966 log.cc:824] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:09.131356 14971 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: No bootstrap required, opened a new log
I20260807 06:20:09.131356 14965 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: No bootstrap required, opened a new log
I20260807 06:20:09.131558 14971 ts_tablet_manager.cc:1397] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:20:09.131558 14965 ts_tablet_manager.cc:1397] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:20:09.132257 14966 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: No bootstrap required, opened a new log
I20260807 06:20:09.132477 14966 ts_tablet_manager.cc:1397] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:20:09.135676 14966 raft_consensus.cc:348] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.136003 14966 raft_consensus.cc:374] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:09.136070 14966 raft_consensus.cc:729] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f60bf55c6444faebdc3c8d259ac0580, State: Initialized, Role: FOLLOWER
I20260807 06:20:09.135964 14965 raft_consensus.cc:348] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.136008 14971 raft_consensus.cc:348] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.136212 14965 raft_consensus.cc:374] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:09.136211 14971 raft_consensus.cc:374] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:09.136272 14965 raft_consensus.cc:729] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5612e1777e419792829d4252fa2e3a, State: Initialized, Role: FOLLOWER
I20260807 06:20:09.136272 14971 raft_consensus.cc:729] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9c5ffbc19941938468c93b3419b1a7, State: Initialized, Role: FOLLOWER
I20260807 06:20:09.136656 14966 consensus_queue.cc:260] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.136713 14971 consensus_queue.cc:260] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.136713 14965 consensus_queue.cc:260] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.137401 14939 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
I20260807 06:20:09.137743 14965 ts_tablet_manager.cc:1428] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:20:09.137732 14971 ts_tablet_manager.cc:1428] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:20:09.137744 14966 ts_tablet_manager.cc:1428] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 06:20:09.138085 14572 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
I20260807 06:20:09.138273 14751 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
W20260807 06:20:09.302589 14941 tablet.cc:2369] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:20:09.320327 14752 tablet.cc:2369] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:20:09.328933 14573 tablet.cc:2369] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:09.356819 14978 raft_consensus.cc:482] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:09.357112 14978 raft_consensus.cc:504] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.358502 14978 leader_election.cc:288] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
I20260807 06:20:09.363162 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.359113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35245 (local address 127.26.252.67:46355)
0807 06:20:09.359281 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.359285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.359586 (+ 301us) server_negotiation.cc:407] Connection header received
0807 06:20:09.359655 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.359658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.359716 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.359818 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.360176 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.360835 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362026 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.362569 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362670 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.362713 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.362942 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.363029 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:20:09.363173 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.358964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46355 (local address 127.26.252.65:35245)
0807 06:20:09.359379 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.359396 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.359519 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.359847 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.359851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.359890 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.360024 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.360033 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.360947 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.360950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.361892 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.361902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.362691 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.362805 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.362832 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.362911 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.362982 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":217,"threads_started":1}
I20260807 06:20:09.363287 14964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.359647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:49711 (local address 127.26.252.66:35993)
0807 06:20:09.359818 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.359823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.360047 (+ 224us) server_negotiation.cc:407] Connection header received
0807 06:20:09.360131 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.360136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.360192 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.360251 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.360544 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.361131 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362186 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.362686 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362807 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.362855 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.363089 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.363157 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:20:09.363516 14987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.359508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.26.252.65:49711)
0807 06:20:09.359940 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.359954 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.360049 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.360291 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.360294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.360312 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.360431 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.360437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.361252 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.361256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.362053 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.362063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.362821 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.362824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.362945 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.362971 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.363048 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.363116 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":100,"threads_started":1}
I20260807 06:20:09.363884 14874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee3ad7aeedf4830800e7653d9cb9ed6" candidate_uuid: "0c9c5ffbc19941938468c93b3419b1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f60bf55c6444faebdc3c8d259ac0580" is_pre_election: true
I20260807 06:20:09.364137 14692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee3ad7aeedf4830800e7653d9cb9ed6" candidate_uuid: "0c9c5ffbc19941938468c93b3419b1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5612e1777e419792829d4252fa2e3a" is_pre_election: true
I20260807 06:20:09.364225 14874 raft_consensus.cc:2454] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c9c5ffbc19941938468c93b3419b1a7 in term 0.
I20260807 06:20:09.364430 14692 raft_consensus.cc:2454] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c9c5ffbc19941938468c93b3419b1a7 in term 0.
I20260807 06:20:09.364737 14413 leader_election.cc:302] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7, 9f60bf55c6444faebdc3c8d259ac0580; no voters:
I20260807 06:20:09.365015 14978 raft_consensus.cc:2781] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:09.365105 14978 raft_consensus.cc:482] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:09.365137 14978 raft_consensus.cc:3037] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:09.366248 14978 raft_consensus.cc:504] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.366629 14978 leader_election.cc:288] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
I20260807 06:20:09.367139 14874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee3ad7aeedf4830800e7653d9cb9ed6" candidate_uuid: "0c9c5ffbc19941938468c93b3419b1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f60bf55c6444faebdc3c8d259ac0580"
I20260807 06:20:09.367167 14692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee3ad7aeedf4830800e7653d9cb9ed6" candidate_uuid: "0c9c5ffbc19941938468c93b3419b1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5612e1777e419792829d4252fa2e3a"
I20260807 06:20:09.367298 14874 raft_consensus.cc:3037] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:09.367311 14692 raft_consensus.cc:3037] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:09.368360 14692 raft_consensus.cc:2454] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c9c5ffbc19941938468c93b3419b1a7 in term 1.
I20260807 06:20:09.368507 14874 raft_consensus.cc:2454] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c9c5ffbc19941938468c93b3419b1a7 in term 1.
I20260807 06:20:09.368637 14413 leader_election.cc:302] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7, 8e5612e1777e419792829d4252fa2e3a; no voters:
I20260807 06:20:09.368882 14978 raft_consensus.cc:2781] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:09.369141 14978 raft_consensus.cc:686] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 0c9c5ffbc19941938468c93b3419b1a7, State: Running, Role: LEADER
I20260807 06:20:09.369519 14978 consensus_queue.cc:237] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.373173 14299 catalog_manager.cc:5495] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65). New cstate: current_term: 1 leader_uuid: "0c9c5ffbc19941938468c93b3419b1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } health_report { overall_health: UNKNOWN } } }
I20260807 06:20:09.412119 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.408302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54228 (local address 127.26.252.65:33165)
0807 06:20:09.408439 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.408443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.408457 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:20:09.408539 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.408541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.408596 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.408729 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:09.408975 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.409475 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.410403 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.410738 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.410841 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.411153 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:09.411697 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:09.411803 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.411939 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.411999 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:20:09.418550 14692 raft_consensus.cc:1261] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Refusing update from remote peer 0c9c5ffbc19941938468c93b3419b1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:09.418541 14874 raft_consensus.cc:1261] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Refusing update from remote peer 0c9c5ffbc19941938468c93b3419b1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:09.419339 14978 consensus_queue.cc:1035] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:09.419574 14988 consensus_queue.cc:1035] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:09.429116 14995 mvcc.cc:205] Tried to move back new op lower bound from 7315798464170512384 to 7315798463980396544. Current Snapshot: MvccSnapshot[applied={T|T < 7315798464170512384 or (T in {7315798464170512384})}]
I20260807 06:20:09.430599 14994 mvcc.cc:205] Tried to move back new op lower bound from 7315798464170512384 to 7315798463980396544. Current Snapshot: MvccSnapshot[applied={T|T < 7315798464170512384}]
I20260807 06:20:09.437072 14300 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:09.437213 14300 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45516:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:09.439921 14300 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Sending DeleteTablet for 3 replicas of tablet 9ee3ad7aeedf4830800e7653d9cb9ed6
I20260807 06:20:09.440701 14845 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:43782
I20260807 06:20:09.441339 14667 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47118
I20260807 06:20:09.441911 15007 tablet_replica.cc:330] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: stopping tablet replica
I20260807 06:20:09.441828 14479 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:54214
I20260807 06:20:09.442255 15007 raft_consensus.cc:2229] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:09.442397 15008 tablet_replica.cc:330] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: stopping tablet replica
I20260807 06:20:09.442622 15007 raft_consensus.cc:2258] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:09.442704 15008 raft_consensus.cc:2229] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:20:09.442914 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 14390
I20260807 06:20:09.443009 15009 tablet_replica.cc:330] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: stopping tablet replica
I20260807 06:20:09.443253 15009 raft_consensus.cc:2229] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:09.443488 15009 raft_consensus.cc:2258] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:09.453649 15007 ts_tablet_manager.cc:1905] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:09.454370 15009 ts_tablet_manager.cc:1905] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:09.456609 15009 ts_tablet_manager.cc:1918] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:09.456749 15009 log.cc:1196] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/9ee3ad7aeedf4830800e7653d9cb9ed6
I20260807 06:20:09.457062 15009 ts_tablet_manager.cc:1939] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting consensus metadata
I20260807 06:20:09.457444 15007 ts_tablet_manager.cc:1918] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:09.457569 15007 log.cc:1196] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/9ee3ad7aeedf4830800e7653d9cb9ed6
I20260807 06:20:09.457979 15007 ts_tablet_manager.cc:1939] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 8e5612e1777e419792829d4252fa2e3a: Deleting consensus metadata
I20260807 06:20:09.458602 14280 catalog_manager.cc:4841] TS 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (table test-table [id=41e79f555ed141a296c2d059f3184a5b]) successfully deleted
I20260807 06:20:09.459350 14280 catalog_manager.cc:4841] TS 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (table test-table [id=41e79f555ed141a296c2d059f3184a5b]) successfully deleted
W20260807 06:20:09.461695 14278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:33165 (error 108)
I20260807 06:20:09.461918 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 14580
I20260807 06:20:09.467850 14962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.462652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:33165 (local address 127.0.0.1:54244)
0807 06:20:09.467653 (+ 5001us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.467739 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:33165: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4873}
W20260807 06:20:09.468726 14278 catalog_manager.cc:4584] TS 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6: Network error: Client connection negotiation failed: client connection to 127.26.252.65:33165: connect: Connection refused (error 111)
I20260807 06:20:09.474058 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 14757
I20260807 06:20:09.487493 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 14259
I20260807 06:20:09.498835 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--webserver_interface=127.26.252.126
--webserver_port=45807
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:09.614296 15011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:09.614634 15011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:09.614679 15011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:09.618636 15011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:09.618690 15011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:09.618708 15011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:09.618724 15011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:09.618741 15011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:09.623824 15011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=45807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:09.624771 15011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:09.625806 15011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:20:09.640107 15011 server_base.cc:1034] running on GCE node
W20260807 06:20:09.640153 15022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:09.640106 15021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:09.640169 15025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:09.641047 15011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:09.642316 15011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:09.643532 15011 hybrid_clock.cc:648] HybridClock initialized: now 1786083609643514 us; error 30 us; skew 500 ppm
Aug 07 06:20:09 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:09.646689 15011 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:09.647686 15011 webserver.cc:460] Webserver started at http://127.26.252.126:45807/ using document root <none> and password file <none>
I20260807 06:20:09.648373 15011 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:09.648506 15011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:09.652856 15011 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:20:09.655304 15033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:09.656700 15011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:20:09.656863 15011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "f732bf3f97e841668f94794ad79ceba0"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "91d798126b64634cae00cb775a802040"
server_key_iv: "172f50fa742e306c62ddd3e449586a57"
server_key_version: "encryptionkey@0"
I20260807 06:20:09.657498 15011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:09.677577 15011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:09.680572 15011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:09.680784 15011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:09.688493 15011 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34675
I20260807 06:20:09.688834 15110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34675 every 8 connection(s)
I20260807 06:20:09.689633 15011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:09.694298 15112 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:20:09.696269 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15011
I20260807 06:20:09.696274 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap starting.
I20260807 06:20:09.696738 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:33165
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=34181
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:09.716070 15112 log.cc:824] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:09.730818 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:09.731400 15112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap complete.
I20260807 06:20:09.739746 15112 raft_consensus.cc:348] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:09.740350 15112 raft_consensus.cc:729] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Initialized, Role: FOLLOWER
I20260807 06:20:09.740970 15112 consensus_queue.cc:260] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:09.741134 15112 raft_consensus.cc:388] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:09.741254 15112 raft_consensus.cc:482] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:09.741381 15112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:20:09.744776 15112 raft_consensus.cc:504] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:09.745244 15112 leader_election.cc:302] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f732bf3f97e841668f94794ad79ceba0; no voters:
I20260807 06:20:09.745642 15112 leader_election.cc:288] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:20:09.745752 15116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:20:09.745983 15116 raft_consensus.cc:686] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 LEADER]: Becoming Leader. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Running, Role: LEADER
I20260807 06:20:09.746320 15116 consensus_queue.cc:237] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:09.747092 15112 sys_catalog.cc:564] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:09.747414 15116 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f732bf3f97e841668f94794ad79ceba0. Latest consensus state: current_term: 2 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:09.747547 15116 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:09.747975 15117 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:09.748152 15117 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:09.753988 15134 catalog_manager.cc:1259] Loaded cluster ID: 2d87549667b246cbb8b2e800d610c083
I20260807 06:20:09.754053 15134 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: loading cluster ID for follower catalog manager: success
W20260807 06:20:09.755046 15134 catalog_manager.cc:1576] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260807 06:20:09.755125 15134 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260807 06:20:09.755195 15121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:09.757578 15121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:09.758061 15121 catalog_manager.cc:1259] Loaded cluster ID: 2d87549667b246cbb8b2e800d610c083
I20260807 06:20:09.758122 15121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:09.759187 15121 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 06:20:09.763846 15121 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 06:20:09.769942 15121 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:09.771119 15121 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Loaded TSK: 0
I20260807 06:20:09.773072 15121 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:20:09.836225 15114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:09.836709 15114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:09.836901 15114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:09.841089 15114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:09.841171 15114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:09.841284 15114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:20:09.846765 15114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:33165
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=34181
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:09.847898 15114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:09.849099 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:09.860407 15147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:09.860409 15148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:09.860503 15150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:09.860975 15114 server_base.cc:1034] running on GCE node
I20260807 06:20:09.861433 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:09.862134 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:09.863336 15114 hybrid_clock.cc:648] HybridClock initialized: now 1786083609863296 us; error 56 us; skew 500 ppm
Aug 07 06:20:09 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:09.866381 15114 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:20:09.867286 15114 webserver.cc:460] Webserver started at http://127.26.252.65:34181/ using document root <none> and password file <none>
I20260807 06:20:09.867854 15114 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:09.867961 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:09.872088 15114 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:20:09.874643 15163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:09.876163 15114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:20:09.876333 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0c9c5ffbc19941938468c93b3419b1a7"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "e10f7e2590ac34bcba9f158c1e0d837a"
server_key_iv: "b10da79688d98a7ac3bb68b2601bff01"
server_key_version: "encryptionkey@0"
I20260807 06:20:09.876955 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:09.898185 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:09.902038 15114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:09.902338 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:09.903137 15114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:09.904546 15171 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:20:09.910712 15114 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:20:09.910820 15114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260807 06:20:09.910930 15114 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:20:09.912906 15114 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:20:09.912981 15114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 06:20:09.913390 15171 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap starting.
I20260807 06:20:09.924129 15114 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:33165
I20260807 06:20:09.924398 15324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:33165 every 8 connection(s)
I20260807 06:20:09.925239 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:20:09.935019 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15114
I20260807 06:20:09.935484 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:35993
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=38377
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:09.937789 15171 log.cc:824] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:20:09 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083609, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:09.944852 15328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.927358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:48205)
0807 06:20:09.927851 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.927905 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.928871 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.931653 (+ 2782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.931660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.932160 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:09.932859 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.932878 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.934198 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.934202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.935484 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.935498 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.936628 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.936632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.936845 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.937597 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:09.937621 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:09.939434 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:09.941657 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:09.941663 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:09.941676 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:09.941989 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:09.942378 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:09.942381 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:09.942383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:09.942571 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:09.943147 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:09.943154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:09.943400 (+ 246us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.943580 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.943916 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":153,"threads_started":1}
I20260807 06:20:09.944839 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.928394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:48205 (local address 127.26.252.126:34675)
0807 06:20:09.930698 (+ 2304us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.930713 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.930750 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:20:09.930963 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.930973 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.931265 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.931600 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:09.933043 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.934024 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.935669 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.936440 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.936631 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.939686 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:09.939693 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:09.939713 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:09.939742 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:09.941512 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.942142 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.942148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.942152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.942267 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:09.942674 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:09.942678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:09.942680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:09.943019 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:09.943176 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.943721 (+ 545us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.943986 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2153,"thread_start_us":123,"threads_started":1}
I20260807 06:20:09.947829 15326 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:09.948087 15326 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:09.948649 15326 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:09.949419 15171 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:09.950011 15171 tablet_bootstrap.cc:492] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap complete.
I20260807 06:20:09.951356 15058 ts_manager.cc:194] Registered new tserver with Master: 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165)
I20260807 06:20:09.951912 15171 ts_tablet_manager.cc:1397] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent bootstrapping tablet: real 0.039s user 0.021s sys 0.016s
I20260807 06:20:09.954859 15058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:48205
I20260807 06:20:09.955212 15171 raft_consensus.cc:348] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.955809 15171 raft_consensus.cc:729] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9c5ffbc19941938468c93b3419b1a7, State: Initialized, Role: FOLLOWER
I20260807 06:20:09.956333 15171 consensus_queue.cc:260] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } }
I20260807 06:20:09.957376 15326 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
I20260807 06:20:09.957461 15171 ts_tablet_manager.cc:1428] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260807 06:20:09.963526 15336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.954625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.26.252.65:33165)
0807 06:20:09.957807 (+ 3182us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:09.957819 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:09.958263 (+ 444us) server_negotiation.cc:407] Connection header received
0807 06:20:09.958527 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:09.958533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:09.958773 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:09.958937 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:09.959240 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.960231 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.962147 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.962814 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.962913 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.963014 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:09.963329 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 06:20:09.963416 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3077,"thread_start_us":112,"threads_started":1}
I20260807 06:20:09.963569 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:09.954176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:33165 (local address 127.0.0.1:54260)
0807 06:20:09.958097 (+ 3921us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:09.958148 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:09.958309 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:09.958955 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:09.958962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:09.958988 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:09.959129 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.959136 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.960359 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.960363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.961964 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:09.961977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:09.962951 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:09.962956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:09.963095 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:09.963142 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:20:09.963272 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 06:20:09.963410 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3731,"thread_start_us":109,"threads_started":1}
I20260807 06:20:09.964694 15231 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:09 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:54260
I20260807 06:20:09.965629 15338 tablet_replica.cc:330] stopping tablet replica
I20260807 06:20:09.966015 15338 raft_consensus.cc:2229] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:09.966310 15338 raft_consensus.cc:2258] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:09.967590 15338 ts_tablet_manager.cc:1905] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:09.972600 15338 ts_tablet_manager.cc:1918] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:09.972738 15338 log.cc:1196] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/9ee3ad7aeedf4830800e7653d9cb9ed6
I20260807 06:20:09.973064 15338 ts_tablet_manager.cc:1939] T 9ee3ad7aeedf4830800e7653d9cb9ed6 P 0c9c5ffbc19941938468c93b3419b1a7: Deleting consensus metadata
I20260807 06:20:09.975386 15034 catalog_manager.cc:4841] TS 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165): tablet 9ee3ad7aeedf4830800e7653d9cb9ed6 (table test-table [id=41e79f555ed141a296c2d059f3184a5b]) successfully deleted
W20260807 06:20:10.065832 15330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:10.066075 15330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:10.066123 15330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:10.070025 15330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:10.070075 15330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:10.070137 15330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:20:10.075196 15330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:35993
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=38377
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:10.076205 15330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:10.077165 15330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:10.087198 15348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:10.087256 15346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:10.087273 15330 server_base.cc:1034] running on GCE node
W20260807 06:20:10.087217 15345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:10.087858 15330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:10.088495 15330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:10.089690 15330 hybrid_clock.cc:648] HybridClock initialized: now 1786083610089673 us; error 28 us; skew 500 ppm
Aug 07 06:20:10 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083610, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:10.092669 15330 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:20:10.093595 15330 webserver.cc:460] Webserver started at http://127.26.252.66:38377/ using document root <none> and password file <none>
I20260807 06:20:10.094362 15330 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:10.094494 15330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:10.098466 15330 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 06:20:10.100505 15357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.101807 15330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:20:10.101950 15330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "8e5612e1777e419792829d4252fa2e3a"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "9c7ceff79dd4e0744ada1baae2b3b8b0"
server_key_iv: "fd1e6c63c826bb597e6345d0ad39b894"
server_key_version: "encryptionkey@0"
I20260807 06:20:10.102530 15330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:10.121737 15330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:10.125155 15330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:10.125361 15330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:10.125970 15330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:10.126884 15330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:10.126957 15330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.127031 15330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:10.127075 15330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.135880 15330 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35993
I20260807 06:20:10.135962 15517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35993 every 8 connection(s)
I20260807 06:20:10.136904 15330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:20:10.145262 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15330
I20260807 06:20:10.145699 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:46355
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=43159
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:20:10 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083610, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:10.151347 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.138865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:57335 (local address 127.26.252.126:34675)
0807 06:20:10.138987 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.138991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.139876 (+ 885us) server_negotiation.cc:407] Connection header received
0807 06:20:10.141252 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.141255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.141314 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.141417 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:10.142611 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.143149 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.144305 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.144544 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.144658 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.147538 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:10.147541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:10.147543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:10.147567 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:10.149239 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.149725 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.149732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.149736 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.149834 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.150161 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.150167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.150171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.150449 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:10.150553 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.151027 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.151160 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:20:10.152109 15521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.139261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:57335)
0807 06:20:10.139731 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.139773 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.141044 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.141605 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.141612 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.141952 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:10.142456 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.142476 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.143280 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.143283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.144173 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.144183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.144696 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.144701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.144877 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.145474 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:10.145490 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:10.147370 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:10.149354 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:10.149359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:10.149370 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:10.149621 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:10.149932 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:10.149935 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:10.149936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:10.150067 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:10.150543 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:10.150548 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:10.150785 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.150984 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.151300 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":119,"threads_started":1}
I20260807 06:20:10.153393 15518 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:10.153643 15518 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:10.154131 15518 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:10.155337 15058 ts_manager.cc:194] Registered new tserver with Master: 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
I20260807 06:20:10.156227 15058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:57335
W20260807 06:20:10.260799 15522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:10.261031 15522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:10.261071 15522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:10.265117 15522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:10.265172 15522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:10.265229 15522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:20:10.270242 15522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:46355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=43159
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:10.271224 15522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:10.272151 15522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:10.281858 15531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:10.281889 15533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:10.282199 15522 server_base.cc:1034] running on GCE node
W20260807 06:20:10.281862 15535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:10.282637 15522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:10.283373 15522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:10.284540 15522 hybrid_clock.cc:648] HybridClock initialized: now 1786083610284527 us; error 23 us; skew 500 ppm
Aug 07 06:20:10 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083610, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:10.287315 15522 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:20:10.288194 15522 webserver.cc:460] Webserver started at http://127.26.252.67:43159/ using document root <none> and password file <none>
I20260807 06:20:10.288749 15522 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:10.288821 15522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:10.292583 15522 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 06:20:10.294749 15543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.296028 15522 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:20:10.296156 15522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "9f60bf55c6444faebdc3c8d259ac0580"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "6e0a6c5299f43ebf4c7ca18381471287"
server_key_iv: "05194cd869cb457ca2451e83f7ff2e08"
server_key_version: "encryptionkey@0"
I20260807 06:20:10.296666 15522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:10.308413 15522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:10.311576 15522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:10.311779 15522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:10.312362 15522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:10.313159 15522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:10.313206 15522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.313274 15522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:10.313313 15522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:10.322695 15522 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:46355
I20260807 06:20:10.322722 15704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:46355 every 8 connection(s)
I20260807 06:20:10.323704 15522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:20:10.323889 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15522
I20260807 06:20:10.333727 15329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.324718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.26.252.126:34675)
0807 06:20:10.324859 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.324863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.325138 (+ 275us) server_negotiation.cc:407] Connection header received
0807 06:20:10.325278 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.325282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.325334 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.325425 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:10.326334 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.327099 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.328429 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.328761 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.328843 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.330485 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:10.330489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:10.330491 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:10.330517 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:10.332004 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.332472 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.332477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.332478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.332566 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.332873 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.332877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.332878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.333049 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:10.333279 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.333419 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.333542 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 06:20:10 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083610, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:10.338550 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.325640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:55693 (local address 127.26.252.126:34675)
0807 06:20:10.325927 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.325933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.326791 (+ 858us) server_negotiation.cc:407] Connection header received
0807 06:20:10.328430 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.328432 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.328480 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.328580 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:10.330099 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.330861 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.332217 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.332440 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.332555 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.335226 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:10.335230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:10.335233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:10.335259 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:10.336718 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.337191 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.337194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.337196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.337272 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:10.337575 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:10.337577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:10.337578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:10.337748 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:10.337824 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.338259 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.338359 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
I20260807 06:20:10.339362 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.326112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:55693)
0807 06:20:10.326641 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.326689 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.328196 (+ 1507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.328720 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.328726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.329239 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:10.329928 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.329952 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.331030 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.331034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.332057 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.332067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.332598 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.332604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.332774 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.333305 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:10.333322 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:10.335077 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:10.336831 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:10.336835 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:10.336845 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:10.337089 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:10.337357 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:10.337360 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:10.337361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:10.337492 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:10.337841 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:10.337846 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:10.338054 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.338211 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.338520 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":157,"threads_started":1}
I20260807 06:20:10.340480 15705 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34675
I20260807 06:20:10.340736 15705 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:10.341223 15705 heartbeater.cc:511] Master 127.26.252.126:34675 requested a full tablet report, sending...
I20260807 06:20:10.342238 15058 ts_manager.cc:194] Registered new tserver with Master: 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355)
I20260807 06:20:10.342887 15058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:55693
I20260807 06:20:10.347985 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:20:10.352569 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.348643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45540 (local address 127.26.252.126:34675)
0807 06:20:10.348767 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.348770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.349048 (+ 278us) server_negotiation.cc:407] Connection header received
0807 06:20:10.349242 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.349246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.349344 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.349451 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:10.349775 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.350262 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.351179 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.351410 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.351524 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.351839 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:10.352183 (+ 344us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:10.352317 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.352382 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.352439 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:20:10.353188 15058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:20:10.356520 15058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:20:10.364991 15231 tablet_service.cc:1467] Processing CreateTablet for tablet aa62a8d85b484f519cabc0ece71863c0 (DEFAULT_TABLE table=test-table [id=14e27aed3c7f41cf867151120cca64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:10.365720 15231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62a8d85b484f519cabc0ece71863c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:10.368633 15171 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap starting.
I20260807 06:20:10.369601 15171 tablet_bootstrap.cc:654] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:10.370002 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.364087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.0.0.1:47134)
0807 06:20:10.364362 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.364378 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.364468 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.365914 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.365918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.365939 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.366203 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.366214 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.367635 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.367639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.368705 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.368715 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.369605 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.369609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.369703 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.369726 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.369794 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.369864 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":135,"threads_started":1}
I20260807 06:20:10.370059 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.364656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.26.252.66:35993)
0807 06:20:10.364986 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.365005 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.365026 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:20:10.365154 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.365159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.365385 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.365722 (+ 337us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.366332 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.367461 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.368862 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.369463 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.369592 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.369772 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.369827 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.369920 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":134,"threads_started":1}
I20260807 06:20:10.370815 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.363802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46355 (local address 127.0.0.1:43788)
0807 06:20:10.363957 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.363974 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.364068 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.365282 (+ 1214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.365285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.365301 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.365399 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.365408 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.366912 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.366915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.367981 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.367991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.370335 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.370339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.370479 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.370503 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.370614 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.370696 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 06:20:10.371093 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.364028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43788 (local address 127.26.252.67:46355)
0807 06:20:10.364757 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.364770 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.364794 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:20:10.364871 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.364877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.365111 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.365563 (+ 452us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.365706 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.366761 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.368134 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.369599 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.369810 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.369971 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.370656 (+ 685us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.370758 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":190,"threads_started":1}
I20260807 06:20:10.371830 15171 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: No bootstrap required, opened a new log
I20260807 06:20:10.371919 15171 ts_tablet_manager.cc:1397] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 06:20:10.372632 15171 raft_consensus.cc:348] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.372758 15171 raft_consensus.cc:374] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:10.372797 15171 raft_consensus.cc:729] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9c5ffbc19941938468c93b3419b1a7, State: Initialized, Role: FOLLOWER
I20260807 06:20:10.372922 15171 consensus_queue.cc:260] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.373165 15171 ts_tablet_manager.cc:1428] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:20:10.373261 15427 tablet_service.cc:1467] Processing CreateTablet for tablet aa62a8d85b484f519cabc0ece71863c0 (DEFAULT_TABLE table=test-table [id=14e27aed3c7f41cf867151120cca64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:10.373669 15614 tablet_service.cc:1467] Processing CreateTablet for tablet aa62a8d85b484f519cabc0ece71863c0 (DEFAULT_TABLE table=test-table [id=14e27aed3c7f41cf867151120cca64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:10.374536 15427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62a8d85b484f519cabc0ece71863c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:10.374878 15614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa62a8d85b484f519cabc0ece71863c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:10.375908 15722 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:10.376135 15722 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.377375 15722 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
I20260807 06:20:10.382472 15328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.377556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46355 (local address 127.26.252.65:50465)
0807 06:20:10.377693 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.377710 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.377798 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.378601 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.378604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.378622 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.378728 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.378746 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.379699 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.379702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.380924 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.380935 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.381982 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.381986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.382112 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.382143 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.382222 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.382297 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 06:20:10.383108 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.378179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:50465 (local address 127.26.252.67:46355)
0807 06:20:10.378292 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.378298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.378312 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:20:10.378356 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.378359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.378400 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.378493 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.378875 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.379563 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.381105 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.381698 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.381831 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.381878 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.382934 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.383005 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:20:10.383502 15723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.377819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.26.252.65:43699)
0807 06:20:10.378068 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.378082 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.378166 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.378757 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.378760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.378778 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.379118 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.379131 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.380203 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.380207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.381550 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.381562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.383023 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.383028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.383158 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.383184 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.383258 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.383338 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":96,"threads_started":1}
I20260807 06:20:10.383992 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.378248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:43699 (local address 127.26.252.66:35993)
0807 06:20:10.378375 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.378380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.378395 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:20:10.378493 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.378497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.378547 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.378639 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.379263 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.380055 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.381725 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.382706 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.383713 (+ 1007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.383770 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.383808 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.383872 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 06:20:10.384935 15725 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Bootstrap starting.
W20260807 06:20:10.385042 15165 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:10.385514 15726 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Bootstrap starting.
I20260807 06:20:10.384471 15451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62a8d85b484f519cabc0ece71863c0" candidate_uuid: "0c9c5ffbc19941938468c93b3419b1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5612e1777e419792829d4252fa2e3a" is_pre_election: true
I20260807 06:20:10.387248 15725 tablet_bootstrap.cc:654] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Neither blocks nor log segments found. Creating new log.
W20260807 06:20:10.387203 15165 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260807 06:20:10.387346 15165 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7; no voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580
I20260807 06:20:10.387852 15337 raft_consensus.cc:2726] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 06:20:10.388180 15725 log.cc:824] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:10.388409 15726 tablet_bootstrap.cc:654] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:10.389093 15726 log.cc:824] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:10.390262 15725 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: No bootstrap required, opened a new log
I20260807 06:20:10.390511 15725 ts_tablet_manager.cc:1397] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:20:10.391036 15726 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: No bootstrap required, opened a new log
I20260807 06:20:10.391197 15726 ts_tablet_manager.cc:1397] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:20:10.392879 15725 raft_consensus.cc:348] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.393153 15725 raft_consensus.cc:374] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:10.393224 15725 raft_consensus.cc:729] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5612e1777e419792829d4252fa2e3a, State: Initialized, Role: FOLLOWER
I20260807 06:20:10.393678 15725 consensus_queue.cc:260] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.394317 15518 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
I20260807 06:20:10.394738 15725 ts_tablet_manager.cc:1428] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:10.394702 15726 raft_consensus.cc:348] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.394963 15726 raft_consensus.cc:374] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:10.395027 15726 raft_consensus.cc:729] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f60bf55c6444faebdc3c8d259ac0580, State: Initialized, Role: FOLLOWER
I20260807 06:20:10.395502 15726 consensus_queue.cc:260] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.396159 15705 heartbeater.cc:503] Master 127.26.252.126:34675 was elected leader, sending a full tablet report...
I20260807 06:20:10.396591 15726 ts_tablet_manager.cc:1428] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260807 06:20:10.427492 15327 tablet.cc:2369] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:20:10.574831 15706 tablet.cc:2369] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:20:10.638485 15520 tablet.cc:2369] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:10.766981 15731 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:10.767330 15731 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.768595 15731 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993), 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165)
I20260807 06:20:10.774266 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.769014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:53457 (local address 127.26.252.65:33165)
0807 06:20:10.769336 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.769342 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.769531 (+ 189us) server_negotiation.cc:407] Connection header received
0807 06:20:10.769708 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.769711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.769764 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.769851 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.770136 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.770925 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.772729 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.773430 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.773583 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.773633 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.774027 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.774115 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":90,"threads_started":1}
I20260807 06:20:10.774260 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.769200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:38531 (local address 127.26.252.66:35993)
0807 06:20:10.769405 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.769409 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.769428 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:20:10.769481 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.769483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.769525 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.769673 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:10.769954 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.770790 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.772729 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.773432 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.773573 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.773633 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.774026 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.774146 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:20:10.774259 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.768905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.26.252.67:38531)
0807 06:20:10.769040 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.769056 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.769163 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.769685 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.769687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.769701 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.769806 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.769810 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.770927 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.770930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.772565 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.772577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.773584 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.773588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.773829 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.773902 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.773987 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.774133 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":265}
I20260807 06:20:10.774269 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.768916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:33165 (local address 127.26.252.67:53457)
0807 06:20:10.769427 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.769438 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:10.769559 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:10.769886 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:10.769890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:10.769909 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:10.770021 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.770026 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.771037 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.771040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.772566 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:10.772577 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.773584 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.773588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:10.773827 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.773902 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 06:20:10.773987 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 06:20:10.774099 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":404,"thread_start_us":110,"threads_started":1}
I20260807 06:20:10.775004 15451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62a8d85b484f519cabc0ece71863c0" candidate_uuid: "9f60bf55c6444faebdc3c8d259ac0580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5612e1777e419792829d4252fa2e3a" is_pre_election: true
I20260807 06:20:10.775004 15253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62a8d85b484f519cabc0ece71863c0" candidate_uuid: "9f60bf55c6444faebdc3c8d259ac0580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9c5ffbc19941938468c93b3419b1a7" is_pre_election: true
I20260807 06:20:10.775265 15253 raft_consensus.cc:2454] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60bf55c6444faebdc3c8d259ac0580 in term 0.
I20260807 06:20:10.775305 15451 raft_consensus.cc:2454] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f60bf55c6444faebdc3c8d259ac0580 in term 0.
I20260807 06:20:10.775749 15545 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580; no voters:
I20260807 06:20:10.776103 15731 raft_consensus.cc:2781] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:10.776203 15731 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:10.776248 15731 raft_consensus.cc:3037] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:10.777340 15731 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.777705 15731 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [CANDIDATE]: Term 1 election: Requested vote from peers 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993), 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165)
I20260807 06:20:10.778075 15451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62a8d85b484f519cabc0ece71863c0" candidate_uuid: "9f60bf55c6444faebdc3c8d259ac0580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5612e1777e419792829d4252fa2e3a"
I20260807 06:20:10.778255 15253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa62a8d85b484f519cabc0ece71863c0" candidate_uuid: "9f60bf55c6444faebdc3c8d259ac0580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9c5ffbc19941938468c93b3419b1a7"
I20260807 06:20:10.778250 15451 raft_consensus.cc:3037] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:10.778451 15253 raft_consensus.cc:3037] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:10.779417 15451 raft_consensus.cc:2454] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60bf55c6444faebdc3c8d259ac0580 in term 1.
I20260807 06:20:10.779492 15253 raft_consensus.cc:2454] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f60bf55c6444faebdc3c8d259ac0580 in term 1.
I20260807 06:20:10.779724 15545 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580; no voters:
I20260807 06:20:10.779915 15731 raft_consensus.cc:2781] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:10.780189 15731 raft_consensus.cc:686] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 LEADER]: Becoming Leader. State: Replica: 9f60bf55c6444faebdc3c8d259ac0580, State: Running, Role: LEADER
I20260807 06:20:10.780519 15731 consensus_queue.cc:237] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:10.784022 15057 catalog_manager.cc:5495] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "9f60bf55c6444faebdc3c8d259ac0580" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } health_report { overall_health: UNKNOWN } } }
I20260807 06:20:10.828037 15718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.824707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43796 (local address 127.26.252.67:46355)
0807 06:20:10.824835 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:10.824839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:10.824853 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:20:10.824984 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:10.824987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:10.825043 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:10.825154 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:10.825363 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.825865 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.826734 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:10.826944 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:10.827024 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:10.827279 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:10.827697 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:10.827787 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:10.827876 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 06:20:10.827920 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:20:10.833781 15451 raft_consensus.cc:1261] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Refusing update from remote peer 9f60bf55c6444faebdc3c8d259ac0580: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:10.833843 15253 raft_consensus.cc:1261] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Refusing update from remote peer 9f60bf55c6444faebdc3c8d259ac0580: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:10.834534 15731 consensus_queue.cc:1035] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:10.834726 15734 consensus_queue.cc:1035] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:10.843112 15740 mvcc.cc:205] Tried to move back new op lower bound from 7315798469968023552 to 7315798469760040960. Current Snapshot: MvccSnapshot[applied={T|T < 7315798469968023552 or (T in {7315798469968023552})}]
I20260807 06:20:10.843389 15741 mvcc.cc:205] Tried to move back new op lower bound from 7315798469968023552 to 7315798469760040960. Current Snapshot: MvccSnapshot[applied={T|T < 7315798469968023552}]
I20260807 06:20:10.844841 15739 mvcc.cc:205] Tried to move back new op lower bound from 7315798469968023552 to 7315798469760040960. Current Snapshot: MvccSnapshot[applied={T|T < 7315798469968023552 or (T in {7315798469968023552})}]
I20260807 06:20:10.850628 15058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:10.850790 15058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:10.853153 15058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Sending DeleteTablet for 3 replicas of tablet aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:10.853932 15231 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62a8d85b484f519cabc0ece71863c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:10 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:54260
I20260807 06:20:10.854001 15614 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62a8d85b484f519cabc0ece71863c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:10 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:43788
I20260807 06:20:10.853994 15427 tablet_service.cc:1514] Processing DeleteTablet for tablet aa62a8d85b484f519cabc0ece71863c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:10 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:47134
I20260807 06:20:10.854401 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 15114
I20260807 06:20:10.854574 15752 tablet_replica.cc:330] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: stopping tablet replica
I20260807 06:20:10.854602 15753 tablet_replica.cc:330] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: stopping tablet replica
I20260807 06:20:10.854732 15752 raft_consensus.cc:2229] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:10.855087 15753 raft_consensus.cc:2229] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:20:10.855504 15753 raft_consensus.cc:2258] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:10.859285 15753 ts_tablet_manager.cc:1905] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:10.862540 15753 ts_tablet_manager.cc:1918] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:10.862675 15754 tablet_replica.cc:330] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: stopping tablet replica
I20260807 06:20:10.862723 15753 log.cc:1196] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:10.863039 15754 raft_consensus.cc:2229] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:10.863286 15753 ts_tablet_manager.cc:1939] T aa62a8d85b484f519cabc0ece71863c0 P 9f60bf55c6444faebdc3c8d259ac0580: Deleting consensus metadata
I20260807 06:20:10.863385 15754 raft_consensus.cc:2258] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:10.865036 15754 ts_tablet_manager.cc:1905] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:10.865391 15035 catalog_manager.cc:4841] TS 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): tablet aa62a8d85b484f519cabc0ece71863c0 (table test-table [id=14e27aed3c7f41cf867151120cca64fb]) successfully deleted
W20260807 06:20:10.868459 15034 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:33165 (error 108)
I20260807 06:20:10.868523 15754 ts_tablet_manager.cc:1918] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:10.868605 15754 log.cc:1196] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:10.868974 15754 ts_tablet_manager.cc:1939] T aa62a8d85b484f519cabc0ece71863c0 P 8e5612e1777e419792829d4252fa2e3a: Deleting consensus metadata
I20260807 06:20:10.869527 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 15330
W20260807 06:20:10.869629 15333 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:20:10.869203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:33165 (local address 127.0.0.1:54270)
0807 06:20:10.869426 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.869509 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:33165: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":136}
W20260807 06:20:10.869879 15034 catalog_manager.cc:4584] TS 0c9c5ffbc19941938468c93b3419b1a7 (127.26.252.65:33165): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa62a8d85b484f519cabc0ece71863c0: Network error: Client connection negotiation failed: client connection to 127.26.252.65:33165: connect: Connection reset by peer (error 104)
I20260807 06:20:10.883325 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 15522
I20260807 06:20:10.885671 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:10.883691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.0.0.1:47146)
0807 06:20:10.885489 (+ 1798us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:10.885559 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.66:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1682}
I20260807 06:20:10.895378 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 15011
I20260807 06:20:10.909092 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--webserver_interface=127.26.252.126
--webserver_port=45807
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:11.024055 15757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:11.024325 15757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:11.024397 15757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:11.028434 15757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:11.028486 15757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:11.028505 15757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:11.028548 15757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:11.028582 15757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:11.033782 15757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=45807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:11.034875 15757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:11.035893 15757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:11.044870 15764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:11.044970 15757 server_base.cc:1034] running on GCE node
W20260807 06:20:11.044888 15766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.045006 15768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:11.045871 15757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:11.047050 15757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:11.048249 15757 hybrid_clock.cc:648] HybridClock initialized: now 1786083611048233 us; error 27 us; skew 500 ppm
Aug 07 06:20:11 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:11.051497 15757 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:11.052481 15757 webserver.cc:460] Webserver started at http://127.26.252.126:45807/ using document root <none> and password file <none>
I20260807 06:20:11.053032 15757 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:11.053100 15757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:11.057207 15757 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:20:11.059540 15777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.060989 15757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:11.061190 15757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "f732bf3f97e841668f94794ad79ceba0"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "91d798126b64634cae00cb775a802040"
server_key_iv: "172f50fa742e306c62ddd3e449586a57"
server_key_version: "encryptionkey@0"
I20260807 06:20:11.061779 15757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:11.076361 15757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:11.080072 15757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:11.080339 15757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:11.088542 15757 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34675
I20260807 06:20:11.088855 15848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34675 every 8 connection(s)
I20260807 06:20:11.089748 15757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:11.094182 15850 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:20:11.095825 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap starting.
I20260807 06:20:11.096079 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15757
I20260807 06:20:11.096575 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:33165
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=34181
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:11.114769 15850 log.cc:824] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:11.126209 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:11.126621 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0: Bootstrap complete.
I20260807 06:20:11.130671 15850 raft_consensus.cc:348] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:11.131057 15850 raft_consensus.cc:729] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Initialized, Role: FOLLOWER
I20260807 06:20:11.131528 15850 consensus_queue.cc:260] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:11.131642 15850 raft_consensus.cc:388] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:11.131726 15850 raft_consensus.cc:482] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:11.131852 15850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:20:11.133677 15850 raft_consensus.cc:504] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:11.134004 15850 leader_election.cc:302] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f732bf3f97e841668f94794ad79ceba0; no voters:
I20260807 06:20:11.134354 15850 leader_election.cc:288] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:20:11.134507 15859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:20:11.134783 15859 raft_consensus.cc:686] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [term 3 LEADER]: Becoming Leader. State: Replica: f732bf3f97e841668f94794ad79ceba0, State: Running, Role: LEADER
I20260807 06:20:11.135108 15859 consensus_queue.cc:237] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } }
I20260807 06:20:11.135581 15850 sys_catalog.cc:564] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:11.136580 15861 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:11.136710 15861 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:11.137540 15862 sys_catalog.cc:455] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f732bf3f97e841668f94794ad79ceba0. Latest consensus state: current_term: 3 leader_uuid: "f732bf3f97e841668f94794ad79ceba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f732bf3f97e841668f94794ad79ceba0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34675 } } }
I20260807 06:20:11.137681 15862 sys_catalog.cc:458] T 00000000000000000000000000000000 P f732bf3f97e841668f94794ad79ceba0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:11.137974 15869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:11.143100 15869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:11.143808 15869 catalog_manager.cc:1259] Loaded cluster ID: 2d87549667b246cbb8b2e800d610c083
I20260807 06:20:11.143872 15869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 06:20:11.144946 15869 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f055fdab9ad google::LogMessage::Fail() at ??:0
@ 0x7f055fdae88a google::LogMessage::SendToLog() at ??:0
@ 0x7f055fdab4de google::LogMessage::Flush() at ??:0
@ 0x7f055fdaca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f056a6eafdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f056a6ebd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f056a6e8579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f056a72c640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f0561ffd3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0561ffdc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f0561fff3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f0561fee512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f05636326db start_thread at ??:0
@ 0x7f055e8a961f clone at ??:0
W20260807 06:20:11.257367 15854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:11.257750 15854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:11.257836 15854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:11.264058 15854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:11.264153 15854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:11.264225 15854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:20:11.270152 15854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:33165
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=34181
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:11.271327 15854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:11.272475 15854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:11.283370 15911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.283448 15914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.283443 15912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:11.284117 15854 server_base.cc:1034] running on GCE node
I20260807 06:20:11.284600 15854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:11.285377 15854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:11.286561 15854 hybrid_clock.cc:648] HybridClock initialized: now 1786083611286537 us; error 49 us; skew 500 ppm
Aug 07 06:20:11 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:11.289762 15854 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:20:11.290908 15854 webserver.cc:460] Webserver started at http://127.26.252.65:34181/ using document root <none> and password file <none>
I20260807 06:20:11.291538 15854 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:11.291620 15854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:11.295981 15854 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:20:11.298488 15924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.299923 15854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:11.300028 15854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0c9c5ffbc19941938468c93b3419b1a7"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "e10f7e2590ac34bcba9f158c1e0d837a"
server_key_iv: "b10da79688d98a7ac3bb68b2601bff01"
server_key_version: "encryptionkey@0"
I20260807 06:20:11.300647 15854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:11.328523 15854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:11.332336 15854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:11.332581 15854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:11.333323 15854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:11.334666 15934 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:20:11.339211 15854 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:20:11.339283 15854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260807 06:20:11.339373 15854 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:20:11.341145 15854 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:20:11.341210 15854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 06:20:11.341490 15934 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap starting.
I20260807 06:20:11.353713 15854 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:33165
I20260807 06:20:11.353924 16082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:33165 every 8 connection(s)
I20260807 06:20:11.355093 15854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:20:11.355625 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 15854
I20260807 06:20:11.356150 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:35993
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=38377
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:11.366703 15934 log.cc:824] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:11.376032 15934 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:11.376547 15934 tablet_bootstrap.cc:492] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Bootstrap complete.
I20260807 06:20:11.378196 15934 ts_tablet_manager.cc:1397] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent bootstrapping tablet: real 0.037s user 0.024s sys 0.007s
I20260807 06:20:11.382395 15934 raft_consensus.cc:348] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:11.382964 15934 raft_consensus.cc:729] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9c5ffbc19941938468c93b3419b1a7, State: Initialized, Role: FOLLOWER
I20260807 06:20:11.383527 15934 consensus_queue.cc:260] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:11.384582 15934 ts_tablet_manager.cc:1428] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7: Time spent starting tablet: real 0.006s user 0.002s sys 0.008s
W20260807 06:20:11.389324 16087 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:20:11.358269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:42463)
0807 06:20:11.359658 (+ 1389us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.359719 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:11.360543 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:11.388517 (+ 27974us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":207,"threads_started":1}
W20260807 06:20:11.389938 16084 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34675 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34675: Client connection negotiation failed: client connection to 127.26.252.126:34675: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:20:11.390843 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.390539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:50261)
0807 06:20:11.390689 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.390782 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 06:20:11.391629 16087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.391382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:38179)
0807 06:20:11.391512 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.391572 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 06:20:11.391846 16084 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:20:11.479187 16086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:11.479504 16086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:11.479588 16086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:11.483692 16086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:11.483770 16086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:11.483855 16086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:20:11.489874 16086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:35993
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=38377
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:11.491276 16086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:11.492802 16086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:11.503758 16099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.503758 16095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.503822 16097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:11.504034 16086 server_base.cc:1034] running on GCE node
I20260807 06:20:11.504540 16086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:11.505470 16086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:11.506668 16086 hybrid_clock.cc:648] HybridClock initialized: now 1786083611506632 us; error 52 us; skew 500 ppm
Aug 07 06:20:11 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:11.509768 16086 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:20:11.510744 16086 webserver.cc:460] Webserver started at http://127.26.252.66:38377/ using document root <none> and password file <none>
I20260807 06:20:11.511313 16086 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:11.511377 16086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:11.515254 16086 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:11.517330 16107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.518680 16086 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:20:11.518803 16086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "8e5612e1777e419792829d4252fa2e3a"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "9c7ceff79dd4e0744ada1baae2b3b8b0"
server_key_iv: "fd1e6c63c826bb597e6345d0ad39b894"
server_key_version: "encryptionkey@0"
I20260807 06:20:11.519349 16086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:11.532225 16086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:11.535166 16086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:11.535385 16086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:11.535995 16086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:11.536837 16086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:11.536886 16086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.536950 16086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:11.536984 16086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.546821 16086 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:35993
I20260807 06:20:11.546896 16260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:35993 every 8 connection(s)
I20260807 06:20:11.547854 16086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:20:11.551945 16264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.550261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:56627)
0807 06:20:11.550766 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.551189 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":153,"threads_started":1}
W20260807 06:20:11.552469 16261 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34675 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34675: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
I20260807 06:20:11.553128 16264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.552910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:55531)
0807 06:20:11.553023 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.553071 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 06:20:11.553861 16264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.553639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:51729)
0807 06:20:11.553764 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.553809 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 06:20:11.554158 16261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:20:11.555826 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 16086
I20260807 06:20:11.556314 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:46355
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:34675
--webserver_port=43159
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:11.672811 16265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:11.673087 16265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:11.673131 16265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:11.676993 16265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:11.677047 16265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:11.677102 16265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:20:11.682271 16265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:46355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=43159
--tserver_master_addrs=127.26.252.126:34675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:11.683398 16265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:11.684396 16265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:11.693953 16274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.693984 16272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:11.693953 16271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:11.694314 16265 server_base.cc:1034] running on GCE node
I20260807 06:20:11.694744 16265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:11.695393 16265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:11.696585 16265 hybrid_clock.cc:648] HybridClock initialized: now 1786083611696572 us; error 27 us; skew 500 ppm
Aug 07 06:20:11 dist-test-slave-68xk krb5kdc[14241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:11.699400 16265 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:20:11.700367 16265 webserver.cc:460] Webserver started at http://127.26.252.67:43159/ using document root <none> and password file <none>
I20260807 06:20:11.700870 16265 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:11.700927 16265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:11.704602 16265 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260807 06:20:11.706838 16284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.708072 16265 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:20:11.708168 16265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "9f60bf55c6444faebdc3c8d259ac0580"
format_stamp: "Formatted at 2026-08-07 06:20:08 on dist-test-slave-68xk"
server_key: "6e0a6c5299f43ebf4c7ca18381471287"
server_key_iv: "05194cd869cb457ca2451e83f7ff2e08"
server_key_version: "encryptionkey@0"
I20260807 06:20:11.708662 16265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:11.737236 16265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:11.740163 16265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:11.740320 16265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:11.740867 16265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:11.741637 16265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:11.741684 16265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.741735 16265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:11.741750 16265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:11.750898 16265 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:46355
I20260807 06:20:11.750928 16442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:46355 every 8 connection(s)
I20260807 06:20:11.751899 16265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:20:11.754274 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 16265
I20260807 06:20:11.756238 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.754045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:52279)
0807 06:20:11.754633 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.754815 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":159,"threads_started":1}
W20260807 06:20:11.756745 16443 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34675 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34675: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
I20260807 06:20:11.757321 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.757117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:52661)
0807 06:20:11.757222 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.757270 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 06:20:11.757927 16446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:11.757731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:40495)
0807 06:20:11.757842 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:11.757882 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 06:20:11.758129 16443 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:20:12.392900 16448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.392426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:45165)
0807 06:20:12.392721 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:12.392782 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":79,"threads_started":1}
I20260807 06:20:12.555277 16449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.554777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:45177)
0807 06:20:12.555116 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:12.555173 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":103,"threads_started":1}
I20260807 06:20:12.759073 16450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.758668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:33965)
0807 06:20:12.758924 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:12.758976 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":71,"threads_started":1}
I20260807 06:20:12.972352 16451 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:12.972601 16451 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:12.973845 16451 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
Aug 07 06:20:12 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.66@KRBTEST.COM
Aug 07 06:20:12 dist-test-slave-68xk krb5kdc[14241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083611, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.67@KRBTEST.COM
I20260807 06:20:12.993316 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.974086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:46355 (local address 127.26.252.65:53241)
0807 06:20:12.974357 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:12.974375 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:12.974511 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:12.976279 (+ 1768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:12.976285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:12.976818 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:12.977324 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:12.977338 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.978733 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.978737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:12.979678 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:12.979688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.980436 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.980440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:12.980675 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:12.985647 (+ 4972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:12.985660 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:12.987921 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:12.990601 (+ 2680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:12.990607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:12.990612 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:12.990812 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:12.991223 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:12.991228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:12.991231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:12.991312 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:12.992114 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:12.992117 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:12.992473 (+ 356us) client_negotiation.cc:769] Sending connection context
0807 06:20:12.992708 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 06:20:12.993091 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":233,"spinlock_wait_cycles":63488,"thread_start_us":91,"threads_started":1}
I20260807 06:20:12.993315 16454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.974507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:35993 (local address 127.26.252.65:48187)
0807 06:20:12.974909 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:12.974923 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:12.975025 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:12.976495 (+ 1470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:12.976498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:12.976817 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:12.977323 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:12.977340 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.978763 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.978766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:12.979669 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:12.979679 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.980418 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.980422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:12.980673 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:12.985632 (+ 4959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:12.985651 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:12.987461 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:12.990183 (+ 2722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:12.990189 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:12.990210 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:12.990548 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:12.990972 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:12.990974 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:12.990975 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:12.991133 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:12.992070 (+ 937us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:12.992077 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:12.992474 (+ 397us) client_negotiation.cc:769] Sending connection context
0807 06:20:12.992708 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 06:20:12.993143 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":333,"spinlock_wait_cycles":36736,"thread_start_us":106,"threads_started":1}
I20260807 06:20:12.993465 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.974817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:48187 (local address 127.26.252.66:35993)
0807 06:20:12.975125 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:12.975149 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:12.975190 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:20:12.975839 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:12.975844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:12.976210 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:12.976523 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:12.977505 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.978582 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.979814 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.980287 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.980456 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:12.987732 (+ 7276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:12.987740 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:12.987757 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:12.987796 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:12.989968 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:12.990686 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:12.990692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:12.990696 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:12.990830 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:12.991272 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:12.991276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:12.991277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:12.991918 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:12.992079 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:12.992889 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 06:20:12.993246 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":122,"threads_started":1}
I20260807 06:20:12.994165 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:12.974244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:53241 (local address 127.26.252.67:46355)
0807 06:20:12.974568 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:12.974603 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:12.974650 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:20:12.975515 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:12.975523 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:12.975895 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:12.976151 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:12.977517 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.978573 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.979831 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:12.980290 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:12.980473 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:12.988207 (+ 7734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:12.988217 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:12.988235 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:12.988280 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:12.990364 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:12.990939 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:12.990949 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:12.990955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:12.991117 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:12.991410 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:12.991414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:12.991415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:12.991918 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:12.992079 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:12.992889 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 06:20:12.993272 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":103,"threads_started":1}
W20260807 06:20:12.996137 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
W20260807 06:20:12.996424 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:12.996517 15926 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7; no voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580
I20260807 06:20:12.996798 16451 raft_consensus.cc:2726] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:20:13.394150 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:13.393785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:47183)
0807 06:20:13.393954 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:13.394030 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 06:20:13.556733 16457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:13.556116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:36553)
0807 06:20:13.556546 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:13.556612 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":105,"threads_started":1}
I20260807 06:20:13.760241 16459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:13.759799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:38311)
0807 06:20:13.760075 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:13.760141 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":75,"threads_started":1}
I20260807 06:20:14.395542 16460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:14.395053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:41107)
0807 06:20:14.395381 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:14.395443 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":88,"threads_started":1}
I20260807 06:20:14.557950 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:14.557483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:44105)
0807 06:20:14.557743 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:14.557803 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260807 06:20:14.761476 16462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:14.760992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:54709)
0807 06:20:14.761292 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:14.761362 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":99,"threads_started":1}
I20260807 06:20:14.799407 16463 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:14.799592 16463 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:14.800097 16463 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
W20260807 06:20:14.800981 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
W20260807 06:20:14.801162 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:14.801285 15926 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7; no voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580
I20260807 06:20:14.801486 16463 raft_consensus.cc:2726] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:20:15.396924 16464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:15.396421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:35977)
0807 06:20:15.396751 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:15.396817 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":83,"threads_started":1}
I20260807 06:20:15.559427 16467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:15.558844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:40611)
0807 06:20:15.559204 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:15.559266 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":82,"threads_started":1}
I20260807 06:20:15.762849 16468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:15.762316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:35587)
0807 06:20:15.762682 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:15.762749 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":141,"threads_started":1}
I20260807 06:20:16.398542 16469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:16.397921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:56839)
0807 06:20:16.398276 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:16.398348 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":77,"threads_started":1}
I20260807 06:20:16.560703 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:16.560291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:40653)
0807 06:20:16.560558 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:16.560611 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":97,"threads_started":1}
I20260807 06:20:16.764178 16474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:16.763761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:33873)
0807 06:20:16.764023 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:16.764080 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
I20260807 06:20:17.375285 16476 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:17.375418 16476 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:17.375771 16476 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
W20260807 06:20:17.376703 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
W20260807 06:20:17.376885 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:17.376943 15926 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7; no voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580
I20260807 06:20:17.377104 16476 raft_consensus.cc:2726] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:20:17.399999 16477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:17.399509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:55471)
0807 06:20:17.399827 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:17.399892 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":85,"threads_started":1}
I20260807 06:20:17.561914 16478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:17.561467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:45501)
0807 06:20:17.561750 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:17.561813 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":79,"threads_started":1}
I20260807 06:20:17.765458 16479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:17.765005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:50919)
0807 06:20:17.765295 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:17.765355 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":90,"threads_started":1}
I20260807 06:20:18.401322 16481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:18.400861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:58991)
0807 06:20:18.401150 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:18.401216 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":81,"threads_started":1}
I20260807 06:20:18.563265 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:18.562781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:38249)
0807 06:20:18.563080 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:18.563136 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":80,"threads_started":1}
I20260807 06:20:18.766798 16483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:18.766189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:39609)
0807 06:20:18.766637 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:18.766700 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":75,"threads_started":1}
I20260807 06:20:19.402555 16484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:19.402089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:41289)
0807 06:20:19.402343 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:19.402399 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":77,"threads_started":1}
I20260807 06:20:19.564405 16485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:19.564000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:60819)
0807 06:20:19.564254 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:19.564309 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":97,"threads_started":1}
I20260807 06:20:19.768131 16486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:19.767673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:44275)
0807 06:20:19.767951 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:19.768007 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":98,"threads_started":1}
I20260807 06:20:20.403762 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:20.403342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:43417)
0807 06:20:20.403600 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:20.403658 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":81,"threads_started":1}
I20260807 06:20:20.565620 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:20.565127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:47735)
0807 06:20:20.565455 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:20.565515 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":135,"threads_started":1}
I20260807 06:20:20.769323 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:20.768920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:59247)
0807 06:20:20.769163 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:20.769226 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":76,"threads_started":1}
I20260807 06:20:21.405175 16492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:21.404701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:34845)
0807 06:20:21.404991 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:21.405064 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":82,"threads_started":1}
I20260807 06:20:21.566952 16493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:21.566517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:58119)
0807 06:20:21.566792 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:21.566853 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":93,"threads_started":1}
I20260807 06:20:21.770687 16494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:21.770183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:54745)
0807 06:20:21.770519 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:21.770578 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":94,"threads_started":1}
I20260807 06:20:21.804582 16495 raft_consensus.cc:482] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:21.804749 16495 raft_consensus.cc:504] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f60bf55c6444faebdc3c8d259ac0580" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 46355 } } peers { permanent_uuid: "8e5612e1777e419792829d4252fa2e3a" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 35993 } } peers { permanent_uuid: "0c9c5ffbc19941938468c93b3419b1a7" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 33165 } }
I20260807 06:20:21.805250 16495 leader_election.cc:288] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355), 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993)
W20260807 06:20:21.806027 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9f60bf55c6444faebdc3c8d259ac0580 (127.26.252.67:46355): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
W20260807 06:20:21.806187 15926 leader_election.cc:341] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e5612e1777e419792829d4252fa2e3a (127.26.252.66:35993): Not found: Tablet not found: aa62a8d85b484f519cabc0ece71863c0
I20260807 06:20:21.806253 15926 leader_election.cc:302] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c9c5ffbc19941938468c93b3419b1a7; no voters: 8e5612e1777e419792829d4252fa2e3a, 9f60bf55c6444faebdc3c8d259ac0580
I20260807 06:20:21.806468 16495 raft_consensus.cc:2726] T aa62a8d85b484f519cabc0ece71863c0 P 0c9c5ffbc19941938468c93b3419b1a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:20:22.406559 16496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:22.405999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:56167)
0807 06:20:22.406310 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:22.406376 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
I20260807 06:20:22.568233 16498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:22.567775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:45703)
0807 06:20:22.568045 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:22.568103 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":76,"threads_started":1}
I20260807 06:20:22.771907 16499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:22.771485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:54909)
0807 06:20:22.771762 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:22.771819 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":95,"threads_started":1}
I20260807 06:20:23.407939 16500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:23.407394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:35985)
0807 06:20:23.407756 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:23.407827 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":87,"threads_started":1}
I20260807 06:20:23.569463 16501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:23.568998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:51085)
0807 06:20:23.569307 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:23.569365 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":109,"threads_started":1}
I20260807 06:20:23.773263 16502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:23.772642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:35871)
0807 06:20:23.773023 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:23.773098 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":125,"threads_started":1}
I20260807 06:20:24.409363 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:24.408859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:35405)
0807 06:20:24.409183 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:24.409245 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":86,"threads_started":1}
I20260807 06:20:24.570904 16505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:24.570268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:56467)
0807 06:20:24.570740 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:24.570802 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":159,"threads_started":1}
I20260807 06:20:24.774632 16508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:24.774060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:52735)
0807 06:20:24.774403 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:24.774530 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":111,"threads_started":1}
I20260807 06:20:25.410537 16509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:25.410095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:38267)
0807 06:20:25.410345 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:25.410424 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":77,"threads_started":1}
I20260807 06:20:25.572084 16510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:25.571670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:53705)
0807 06:20:25.571932 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:25.571988 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
I20260807 06:20:25.775861 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:25.775404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:46393)
0807 06:20:25.775693 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:25.775765 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":128,"threads_started":1}
I20260807 06:20:26.411947 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:26.411481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.65:48865)
0807 06:20:26.411791 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:26.411849 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":131,"threads_started":1}
I20260807 06:20:26.573544 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:26.573087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.66:53445)
0807 06:20:26.573383 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:26.573442 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":79,"threads_started":1}
I20260807 06:20:26.759153 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 15854
I20260807 06:20:26.772670 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 16086
I20260807 06:20:26.778093 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:26.777674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34675 (local address 127.26.252.67:50277)
0807 06:20:26.777944 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:26.777998 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":91,"threads_started":1}
I20260807 06:20:26.782811 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 16265
2026-08-07T06:20:26Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20102 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:20:26 dist-test-slave-68xk krb5kdc[16521](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:20:26 dist-test-slave-68xk krb5kdc[16521](info): set up 2 sockets
Aug 07 06:20:26 dist-test-slave-68xk krb5kdc[16521](info): commencing operation
krb5kdc: starting...
W20260807 06:20:28.016492 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:20:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:20:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:20:28.150620 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:28.263584 16541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:28.263883 16541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:28.263971 16541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:28.267970 16541 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:20:28.268040 16541 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:20:28.268069 16541 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:20:28.268110 16541 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:28.268153 16541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:28.268213 16541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:28.268253 16541 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:28.268288 16541 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:28.273378 16541 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:28.274423 16541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:28.275504 16541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:28.284186 16553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.284415 16551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.284186 16555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:28.284493 16541 server_base.cc:1034] running on GCE node
I20260807 06:20:28.285250 16541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:28.286541 16541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:28.287767 16541 hybrid_clock.cc:648] HybridClock initialized: now 1786083628287735 us; error 50 us; skew 500 ppm
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:28.290738 16541 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:28.291735 16541 webserver.cc:460] Webserver started at http://127.26.252.126:38285/ using document root <none> and password file <none>
I20260807 06:20:28.292361 16541 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:28.292464 16541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:28.292721 16541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:28.295002 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "4999c86441584019976456f39bd24ebe"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "dd45a75f8d7ee46cab93b7505777779c"
server_key_iv: "c4e37c4728632a01f9848c91dd25b2a2"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.295646 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "4999c86441584019976456f39bd24ebe"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "dd45a75f8d7ee46cab93b7505777779c"
server_key_iv: "c4e37c4728632a01f9848c91dd25b2a2"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.299749 16541 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:28.302446 16565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.303750 16541 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260807 06:20:28.303911 16541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "4999c86441584019976456f39bd24ebe"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "dd45a75f8d7ee46cab93b7505777779c"
server_key_iv: "c4e37c4728632a01f9848c91dd25b2a2"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.304037 16541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:28.318190 16541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:28.321744 16541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:28.321979 16541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:28.329927 16541 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34787
I20260807 06:20:28.330228 16632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34787 every 8 connection(s)
I20260807 06:20:28.331027 16541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:28.333937 16633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:28.337762 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 16541
I20260807 06:20:28.337917 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:20:28.338241 27633 external_mini_cluster.cc:1428] Setting key f76f8d75a754ce4681b99d7a7d5d5db6
I20260807 06:20:28.340101 16633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap starting.
I20260807 06:20:28.342589 16633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:28.343461 16633 log.cc:824] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:28.345292 16633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: No bootstrap required, opened a new log
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:28.349176 16633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:28.349454 16633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:28.349589 16633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4999c86441584019976456f39bd24ebe, State: Initialized, Role: FOLLOWER
I20260807 06:20:28.350111 16633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:28.350281 16633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:28.350375 16633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:28.350497 16633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:28.351351 16633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:28.351742 16633 leader_election.cc:302] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4999c86441584019976456f39bd24ebe; no voters:
I20260807 06:20:28.352109 16633 leader_election.cc:288] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:20:28.352231 16639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:28.352492 16639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 LEADER]: Becoming Leader. State: Replica: 4999c86441584019976456f39bd24ebe, State: Running, Role: LEADER
I20260807 06:20:28.352838 16639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:28.353468 16633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:28.354682 16642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4999c86441584019976456f39bd24ebe. Latest consensus state: current_term: 1 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:20:28.354806 16642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:28.354950 16637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:28.339744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57106 (local address 127.26.252.126:34787)
0807 06:20:28.340281 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:28.340312 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:28.340353 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:20:28.341046 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:28.341072 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:28.341413 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:28.341722 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:28.342743 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.343999 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.345063 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.345639 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.345836 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:28.348897 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:28.348902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:28.348918 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:28.348948 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:28.351080 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.351564 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.351570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.351576 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.351715 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.352057 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.352062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.352064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.352593 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:28.353404 (+ 811us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:28.353563 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 06:20:28.353870 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":137,"threads_started":1}
I20260807 06:20:28.355224 16651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:28.355875 16641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:20:28.355978 16641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:28.358215 16651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:28.363389 16651 catalog_manager.cc:1347] Generated new cluster ID: ef6ef6c593ff4dd299b5afcedfe12f95
I20260807 06:20:28.363451 16651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:28.377264 16651 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:20:28.378400 16651 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:28.383705 16651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Generated new TSK 0
I20260807 06:20:28.384308 16651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:20:28.425798 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:28.549981 16668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:28.550295 16668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:28.550338 16668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:28.554528 16668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:28.554593 16668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:28.554682 16668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:20:28.560156 16668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:28.561233 16668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:28.562289 16668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:28.572187 16676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.572166 16674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.572268 16673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:28.572593 16668 server_base.cc:1034] running on GCE node
I20260807 06:20:28.573007 16668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:28.573748 16668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:28.574978 16668 hybrid_clock.cc:648] HybridClock initialized: now 1786083628574955 us; error 39 us; skew 500 ppm
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:28.578225 16668 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:20:28.579290 16668 webserver.cc:460] Webserver started at http://127.26.252.65:35397/ using document root <none> and password file <none>
I20260807 06:20:28.579913 16668 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:28.580014 16668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:28.580298 16668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:28.582620 16668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "b57b77c89acd520e449621f95cb0c5fc"
server_key_iv: "2a47307f1a493d4fcb70032c3204a822"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.583173 16668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "b57b77c89acd520e449621f95cb0c5fc"
server_key_iv: "2a47307f1a493d4fcb70032c3204a822"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.587117 16668 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:20:28.589599 16690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.590937 16668 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:20:28.591075 16668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "b57b77c89acd520e449621f95cb0c5fc"
server_key_iv: "2a47307f1a493d4fcb70032c3204a822"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.591187 16668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:28.603509 16668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:28.606552 16668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:28.606750 16668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:28.607362 16668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:28.608196 16668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:28.608243 16668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.608322 16668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:28.608354 16668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.617864 16668 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38095
I20260807 06:20:28.617892 16848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38095 every 8 connection(s)
I20260807 06:20:28.618801 16668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:20:28.623621 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 16668
I20260807 06:20:28.623795 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:20:28.624110 27633 external_mini_cluster.cc:1428] Setting key 9f515de2b0e778246ebc0bd3769aefd6
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:28.633545 16637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:28.620857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:50097 (local address 127.26.252.126:34787)
0807 06:20:28.620987 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:28.620991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:28.621829 (+ 838us) server_negotiation.cc:407] Connection header received
0807 06:20:28.623206 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:28.623209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:28.623259 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:28.623336 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:28.624938 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.625630 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.626860 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.627088 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.627217 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:28.629892 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:28.629895 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:28.629900 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:28.629930 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:28.631450 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.631977 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.631981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.631983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.632068 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.632421 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.632427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.632428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.632610 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:28.632726 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:28.633241 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 06:20:28.633372 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:20:28.634512 16852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:28.621178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:50097)
0807 06:20:28.621662 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:28.621706 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:28.622935 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:28.623572 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:28.623582 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:28.624097 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:28.624776 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:28.624797 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.625765 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.625769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:28.626731 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:28.626742 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.627258 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.627263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:28.627431 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:28.628044 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:28.628061 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:28.629725 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:28.631576 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:28.631582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:28.631595 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:28.631866 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:28.632164 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:28.632170 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:28.632175 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:28.632319 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:28.632725 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:28.632733 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:28.632989 (+ 256us) client_negotiation.cc:769] Sending connection context
0807 06:20:28.633176 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 06:20:28.633492 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":129,"threads_started":1}
I20260807 06:20:28.635756 16850 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:28.635993 16850 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:28.636484 16850 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:20:28.638204 16587 ts_manager.cc:194] Registered new tserver with Master: 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:28.639356 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:50097
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:20:28.654799 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:28.772665 16859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:28.772948 16859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:28.773032 16859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:28.777017 16859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:28.777101 16859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:28.777201 16859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:20:28.782580 16859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:28.783645 16859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:28.784693 16859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:28.794391 16864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.794466 16868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:28.794512 16866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:28.794406 16859 server_base.cc:1034] running on GCE node
I20260807 06:20:28.795068 16859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:28.795786 16859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:28.796985 16859 hybrid_clock.cc:648] HybridClock initialized: now 1786083628796955 us; error 41 us; skew 500 ppm
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:28.800007 16859 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:20:28.800951 16859 webserver.cc:460] Webserver started at http://127.26.252.66:46101/ using document root <none> and password file <none>
I20260807 06:20:28.801602 16859 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:28.801712 16859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:28.801970 16859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:28.804230 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "d0739ca78b33dbf505fc15232edfe556"
server_key_iv: "7543e664573ada43de921bbea6bd4d70"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.804853 16859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "d0739ca78b33dbf505fc15232edfe556"
server_key_iv: "7543e664573ada43de921bbea6bd4d70"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.809022 16859 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260807 06:20:28.811853 16879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.813107 16859 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:20:28.813261 16859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "d0739ca78b33dbf505fc15232edfe556"
server_key_iv: "7543e664573ada43de921bbea6bd4d70"
server_key_version: "encryptionkey@0"
I20260807 06:20:28.813365 16859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:28.827157 16859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:28.830045 16859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:28.830252 16859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:28.830901 16859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:28.831698 16859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:28.831756 16859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.831795 16859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:28.831842 16859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:28.841353 16859 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:38769
I20260807 06:20:28.841378 17041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:38769 every 8 connection(s)
I20260807 06:20:28.842219 16859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:20:28.852135 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 16859
I20260807 06:20:28.852276 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
Aug 07 06:20:28 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083628, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:28.852633 27633 external_mini_cluster.cc:1428] Setting key fa59b68da119f1df2fd63f0904f5cf7c
I20260807 06:20:28.857239 16637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:28.844271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:44407 (local address 127.26.252.126:34787)
0807 06:20:28.844420 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:28.844424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:28.845385 (+ 961us) server_negotiation.cc:407] Connection header received
0807 06:20:28.846833 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:28.846836 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:28.846892 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:28.846987 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:28.848228 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.848766 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.849994 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.850274 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.850374 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:28.853370 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:28.853374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:28.853378 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:28.853406 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:28.855117 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.855710 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.855714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.855716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.855802 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:28.856152 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:28.856156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:28.856158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:28.856346 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:28.856455 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:28.856953 (+ 498us) server_negotiation.cc:299] Negotiation successful
0807 06:20:28.857076 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:20:28.858119 17044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:28.844684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:44407)
0807 06:20:28.845213 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:28.845258 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:28.846606 (+ 1348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:28.847161 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:28.847168 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:28.847539 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:28.848049 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:28.848064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.848890 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.848893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:28.849858 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:28.849867 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:28.850491 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:28.850496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:28.850665 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:28.851267 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:28.851285 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:28.853121 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:28.855301 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:28.855307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:28.855322 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:28.855599 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:28.855900 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:28.855903 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:28.855905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:28.856052 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:28.856458 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:28.856467 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:28.856712 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 06:20:28.856908 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 06:20:28.857255 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":135,"threads_started":1}
I20260807 06:20:28.859416 17042 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:28.859687 17042 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:28.860268 17042 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
I20260807 06:20:28.861413 16587 ts_manager.cc:194] Registered new tserver with Master: b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66:38769)
I20260807 06:20:28.862047 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:44407
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:20:28.886824 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:29.016144 17048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:29.016456 17048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:29.016559 17048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:29.022255 17048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:29.022322 17048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:29.022452 17048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:20:29.028259 17048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:29.029345 17048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:29.030507 17048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:29.040951 17056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:29.040934 17060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:29.040915 17057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:29.041405 17048 server_base.cc:1034] running on GCE node
I20260807 06:20:29.041836 17048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:29.042598 17048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:29.043766 17048 hybrid_clock.cc:648] HybridClock initialized: now 1786083629043734 us; error 42 us; skew 500 ppm
Aug 07 06:20:29 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083629, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:29.046973 17048 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:20:29.047878 17048 webserver.cc:460] Webserver started at http://127.26.252.67:37607/ using document root <none> and password file <none>
I20260807 06:20:29.048480 17048 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:29.048579 17048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:29.048835 17048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:20:29.051043 17048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "3724160fd4b549c2b05a4fe43aa82a17"
format_stamp: "Formatted at 2026-08-07 06:20:29 on dist-test-slave-68xk"
server_key: "c03b785f782dffc73f52ebd96e8cab8f"
server_key_iv: "0e0e4ecc261bde8fef609bb56ec1d0eb"
server_key_version: "encryptionkey@0"
I20260807 06:20:29.051671 17048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "3724160fd4b549c2b05a4fe43aa82a17"
format_stamp: "Formatted at 2026-08-07 06:20:29 on dist-test-slave-68xk"
server_key: "c03b785f782dffc73f52ebd96e8cab8f"
server_key_iv: "0e0e4ecc261bde8fef609bb56ec1d0eb"
server_key_version: "encryptionkey@0"
I20260807 06:20:29.055795 17048 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:20:29.058516 17069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:29.059782 17048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:20:29.059945 17048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "3724160fd4b549c2b05a4fe43aa82a17"
format_stamp: "Formatted at 2026-08-07 06:20:29 on dist-test-slave-68xk"
server_key: "c03b785f782dffc73f52ebd96e8cab8f"
server_key_iv: "0e0e4ecc261bde8fef609bb56ec1d0eb"
server_key_version: "encryptionkey@0"
I20260807 06:20:29.060066 17048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:29.127686 17048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:29.131451 17048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:29.131690 17048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:29.132378 17048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:29.133311 17048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:29.133391 17048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:29.133472 17048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:29.133522 17048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:29.143702 17048 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42641
I20260807 06:20:29.143743 17231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42641 every 8 connection(s)
I20260807 06:20:29.144668 17048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:20:29.147989 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 17048
I20260807 06:20:29.148131 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:20:29.148451 27633 external_mini_cluster.cc:1428] Setting key ea1152755207d5ed1578c1f344a681a5
Aug 07 06:20:29 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083629, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:29.159467 16637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.146982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:35561 (local address 127.26.252.126:34787)
0807 06:20:29.147163 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.147167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.147933 (+ 766us) server_negotiation.cc:407] Connection header received
0807 06:20:29.149553 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.149556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.149623 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.149706 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:29.151057 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.151590 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.152758 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.153006 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.153117 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.155924 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:29.155927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:29.155930 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:29.155959 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:29.157358 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:29.157874 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:29.157879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:29.157881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:29.157962 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:29.158346 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:29.158350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:29.158352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:29.158575 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:29.158685 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.159173 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.159301 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:20:29.160229 17235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.147316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:35561)
0807 06:20:29.147780 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.147824 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.149332 (+ 1508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.149896 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.149907 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.150294 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:29.150914 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.150929 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.151725 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.151729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.152626 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.152635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.153160 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.153164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.153334 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.154113 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:29.154132 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:29.155764 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:29.157479 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:29.157485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:29.157498 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:29.157767 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:29.158058 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:29.158062 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:29.158065 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:29.158207 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:29.158684 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:29.158692 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:29.158927 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.159126 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.159434 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":110,"threads_started":1}
I20260807 06:20:29.161504 17232 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:29.161794 17232 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:29.162473 17232 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
I20260807 06:20:29.163599 16587 ts_manager.cc:194] Registered new tserver with Master: 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641)
I20260807 06:20:29.164301 16587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:35561
I20260807 06:20:29.174021 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:20:29.184082 16637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.176126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57112 (local address 127.26.252.126:34787)
0807 06:20:29.176318 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.176321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.176382 (+ 61us) server_negotiation.cc:407] Connection header received
0807 06:20:29.176483 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.176485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.176524 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.176589 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:29.177283 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.177775 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.178828 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.179035 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.179112 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.180718 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:29.180721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:29.180723 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:29.180744 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:29.182224 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:29.182758 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:29.182761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:29.182762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:29.182840 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:29.183171 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:29.183173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:29.183174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:29.183396 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:29.183498 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.183789 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.183881 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 06:20:29.186924 16587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:20:29.189818 16587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:20:29.205335 17254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.198508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50652 (local address 127.26.252.66:38769)
0807 06:20:29.199518 (+ 1010us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.199534 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.199563 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:20:29.199649 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.199655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.199895 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.200090 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:29.200400 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.201644 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.203452 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.204397 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.204538 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.204701 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.205031 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.205160 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":162,"threads_started":1}
I20260807 06:20:29.205360 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.199069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.0.0.1:40348)
0807 06:20:29.199676 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.199692 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.199779 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.200710 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.200713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.200732 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:29.200842 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.200849 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.202049 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.202052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.203487 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.203498 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.204548 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.204552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.204755 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.204861 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.204975 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.205173 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":171,"thread_start_us":97,"threads_started":1}
I20260807 06:20:29.205950 17260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.199659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.26.252.65:38095)
0807 06:20:29.200238 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.200248 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.200273 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:20:29.200349 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.200354 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.200545 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.200721 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:29.200974 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.201924 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.203617 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.204435 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.204542 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.204701 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.205660 (+ 959us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.205798 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":96,"threads_started":1}
I20260807 06:20:29.205368 17252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.198299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38769 (local address 127.0.0.1:50652)
0807 06:20:29.198880 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.198964 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.199179 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.200070 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.200076 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.200101 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:29.200244 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.200266 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.201791 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.201795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.203317 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.203328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.204548 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.204552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.204795 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.204861 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.204975 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.205173 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":270,"thread_start_us":116,"threads_started":1}
I20260807 06:20:29.206301 17256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.198459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42641 (local address 127.0.0.1:40790)
0807 06:20:29.199324 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.199340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.199438 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.200328 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.200332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.200351 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:29.200441 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.200447 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.201841 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.201844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.203487 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.203498 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.205827 (+ 2329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.205831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.205930 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.205960 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.206021 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.206139 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":146,"thread_start_us":79,"threads_started":1}
I20260807 06:20:29.207149 17259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.199146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40790 (local address 127.26.252.67:42641)
0807 06:20:29.199883 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.199902 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.199920 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:20:29.199979 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.199982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.200187 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.200350 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:29.200542 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.201644 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.204773 (+ 3129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.205673 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.206730 (+ 1057us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.206846 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.206887 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.206984 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":93,"threads_started":1}
I20260807 06:20:29.209580 16941 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5df38823e046cc9d3caf4083283434 (DEFAULT_TABLE table=test-table [id=56961912b2fb4f67a508ff5784e56023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:29.210059 17140 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5df38823e046cc9d3caf4083283434 (DEFAULT_TABLE table=test-table [id=56961912b2fb4f67a508ff5784e56023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:29.211200 16941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5df38823e046cc9d3caf4083283434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:29.211391 17140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5df38823e046cc9d3caf4083283434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:29.212162 16753 tablet_service.cc:1467] Processing CreateTablet for tablet 8b5df38823e046cc9d3caf4083283434 (DEFAULT_TABLE table=test-table [id=56961912b2fb4f67a508ff5784e56023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:29.212984 16753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b5df38823e046cc9d3caf4083283434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:29.219061 17261 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap starting.
I20260807 06:20:29.220222 17267 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Bootstrap starting.
I20260807 06:20:29.221443 17261 tablet_bootstrap.cc:654] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:29.222164 17267 tablet_bootstrap.cc:654] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:29.222332 17261 log.cc:824] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:29.222827 17266 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Bootstrap starting.
I20260807 06:20:29.223448 17267 log.cc:824] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:29.224321 17261 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: No bootstrap required, opened a new log
I20260807 06:20:29.224526 17261 ts_tablet_manager.cc:1397] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:20:29.225376 17266 tablet_bootstrap.cc:654] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:29.225607 17267 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: No bootstrap required, opened a new log
I20260807 06:20:29.225802 17267 ts_tablet_manager.cc:1397] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 06:20:29.226218 17266 log.cc:824] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:29.228221 17266 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: No bootstrap required, opened a new log
I20260807 06:20:29.228463 17266 ts_tablet_manager.cc:1397] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:20:29.228597 17261 raft_consensus.cc:348] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.228840 17261 raft_consensus.cc:374] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:29.228924 17261 raft_consensus.cc:729] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22498bd0baf14047a00ddd9e7d3f56ab, State: Initialized, Role: FOLLOWER
I20260807 06:20:29.229391 17261 consensus_queue.cc:260] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.229542 17267 raft_consensus.cc:348] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.229868 17267 raft_consensus.cc:374] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:29.229966 17267 raft_consensus.cc:729] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3724160fd4b549c2b05a4fe43aa82a17, State: Initialized, Role: FOLLOWER
I20260807 06:20:29.230031 16850 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
I20260807 06:20:29.230394 17261 ts_tablet_manager.cc:1428] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:20:29.230520 17267 consensus_queue.cc:260] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.231231 17232 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
I20260807 06:20:29.231505 17267 ts_tablet_manager.cc:1428] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:20:29.232671 17266 raft_consensus.cc:348] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.232990 17266 raft_consensus.cc:374] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:29.233078 17266 raft_consensus.cc:729] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8fc9bcb71d4425eab5bc17e03f2c0af, State: Initialized, Role: FOLLOWER
I20260807 06:20:29.233479 17266 consensus_queue.cc:260] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.234270 17042 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
I20260807 06:20:29.234478 17266 ts_tablet_manager.cc:1428] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260807 06:20:29.343420 17043 tablet.cc:2369] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:20:29.370230 16851 tablet.cc:2369] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:29.374193 17277 raft_consensus.cc:482] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:29.374466 17277 raft_consensus.cc:504] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.375880 17277 leader_election.cc:288] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641), 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:29.379966 17260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.376332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:54839 (local address 127.26.252.65:38095)
0807 06:20:29.376467 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.376471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.376704 (+ 233us) server_negotiation.cc:407] Connection header received
0807 06:20:29.376871 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.376874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.376926 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.377003 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:29.377316 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.377813 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.378951 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.379380 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.379515 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.379569 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.379758 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.379831 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:20:29.379992 17279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.376226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.26.252.66:54839)
0807 06:20:29.376588 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.376600 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.376746 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.377025 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.377028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.377045 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:29.377187 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.377193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.377925 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.377931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.378813 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.378822 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.379507 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.379511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.379613 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.379643 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.379741 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.379813 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":122,"threads_started":1}
I20260807 06:20:29.380028 17259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.376254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:50125 (local address 127.26.252.67:42641)
0807 06:20:29.376460 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.376466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.376548 (+ 82us) server_negotiation.cc:407] Connection header received
0807 06:20:29.376747 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.376750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.376794 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.376885 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:29.377195 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.377751 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.378963 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.379414 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.379552 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.379620 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.379823 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.379898 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260807 06:20:29.380048 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.376111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42641 (local address 127.26.252.66:50125)
0807 06:20:29.376458 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.376475 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:29.376602 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:29.376898 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:29.376901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:29.376920 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:29.377062 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.377068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.377872 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.377879 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.378808 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:29.378818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.379545 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.379549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:29.379666 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.379691 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:20:29.379792 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:20:29.379867 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":107,"threads_started":1}
I20260807 06:20:29.380887 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5df38823e046cc9d3caf4083283434" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3724160fd4b549c2b05a4fe43aa82a17" is_pre_election: true
I20260807 06:20:29.380942 16782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5df38823e046cc9d3caf4083283434" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" is_pre_election: true
I20260807 06:20:29.381233 16782 raft_consensus.cc:2454] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 0.
I20260807 06:20:29.381233 17171 raft_consensus.cc:2454] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 0.
I20260807 06:20:29.381740 16881 leader_election.cc:302] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22498bd0baf14047a00ddd9e7d3f56ab, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters:
I20260807 06:20:29.382001 17277 raft_consensus.cc:2781] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:29.382108 17277 raft_consensus.cc:482] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:29.382184 17277 raft_consensus.cc:3037] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:29.383379 17277 raft_consensus.cc:504] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.383751 17277 leader_election.cc:288] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 election: Requested vote from peers 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641), 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:29.384073 17171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5df38823e046cc9d3caf4083283434" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3724160fd4b549c2b05a4fe43aa82a17"
I20260807 06:20:29.384194 16782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b5df38823e046cc9d3caf4083283434" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
I20260807 06:20:29.384215 17171 raft_consensus.cc:3037] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:29.384291 16782 raft_consensus.cc:3037] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:29.385492 17171 raft_consensus.cc:2454] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 1.
I20260807 06:20:29.385663 16782 raft_consensus.cc:2454] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 1.
I20260807 06:20:29.385833 16884 leader_election.cc:302] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3724160fd4b549c2b05a4fe43aa82a17, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters:
I20260807 06:20:29.386016 17277 raft_consensus.cc:2781] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:29.386270 17277 raft_consensus.cc:686] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 LEADER]: Becoming Leader. State: Replica: b8fc9bcb71d4425eab5bc17e03f2c0af, State: Running, Role: LEADER
I20260807 06:20:29.386700 17277 consensus_queue.cc:237] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:29.389945 16587 catalog_manager.cc:5495] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af reported cstate change: term changed from 0 to 1, leader changed from <none> to b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66). New cstate: current_term: 1 leader_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } health_report { overall_health: UNKNOWN } } }
W20260807 06:20:29.395778 17234 tablet.cc:2369] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:29.439486 17254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.435693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50664 (local address 127.26.252.66:38769)
0807 06:20:29.435831 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:29.435835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:29.435850 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:20:29.435996 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:29.435999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:29.436067 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:29.436156 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:29.436472 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.436968 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.438005 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:29.438223 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:29.438301 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:29.438687 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:29.439093 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:29.439186 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:29.439252 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 06:20:29.439303 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:20:29.445489 16782 raft_consensus.cc:1261] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Refusing update from remote peer b8fc9bcb71d4425eab5bc17e03f2c0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:29.445489 17171 raft_consensus.cc:1261] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Refusing update from remote peer b8fc9bcb71d4425eab5bc17e03f2c0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:29.446239 17277 consensus_queue.cc:1035] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:29.446472 17281 consensus_queue.cc:1035] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:29.455286 17287 mvcc.cc:205] Tried to move back new op lower bound from 7315798546201174016 to 7315798545970454528. Current Snapshot: MvccSnapshot[applied={T|T < 7315798546201174016}]
I20260807 06:20:29.455483 17289 mvcc.cc:205] Tried to move back new op lower bound from 7315798546201174016 to 7315798545970454528. Current Snapshot: MvccSnapshot[applied={T|T < 7315798546201174016}]
I20260807 06:20:29.463727 16586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:29.463927 16586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:29.466719 16586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Sending DeleteTablet for 3 replicas of tablet 8b5df38823e046cc9d3caf4083283434
I20260807 06:20:29.467594 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 16668
I20260807 06:20:29.467535 16753 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5df38823e046cc9d3caf4083283434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:40348
I20260807 06:20:29.467687 16941 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5df38823e046cc9d3caf4083283434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:50652
I20260807 06:20:29.468271 17140 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5df38823e046cc9d3caf4083283434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:40790
I20260807 06:20:29.473181 17305 tablet_replica.cc:330] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: stopping tablet replica
I20260807 06:20:29.473181 17306 tablet_replica.cc:330] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: stopping tablet replica
I20260807 06:20:29.473513 17305 raft_consensus.cc:2229] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:20:29.473513 17306 raft_consensus.cc:2229] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:29.473825 17306 raft_consensus.cc:2258] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:29.473899 17305 raft_consensus.cc:2258] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:29.475385 17306 ts_tablet_manager.cc:1905] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:29.477888 17306 ts_tablet_manager.cc:1918] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:29.477959 17306 log.cc:1196] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/8b5df38823e046cc9d3caf4083283434
I20260807 06:20:29.478211 17306 ts_tablet_manager.cc:1939] T 8b5df38823e046cc9d3caf4083283434 P 3724160fd4b549c2b05a4fe43aa82a17: Deleting consensus metadata
I20260807 06:20:29.479377 16570 catalog_manager.cc:4841] TS 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641): tablet 8b5df38823e046cc9d3caf4083283434 (table test-table [id=56961912b2fb4f67a508ff5784e56023]) successfully deleted
I20260807 06:20:29.487416 17305 ts_tablet_manager.cc:1905] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:20:29.490358 16567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:38095 (error 108)
I20260807 06:20:29.490475 17305 ts_tablet_manager.cc:1918] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:29.490593 17305 log.cc:1196] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/8b5df38823e046cc9d3caf4083283434
I20260807 06:20:29.490688 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 16859
I20260807 06:20:29.495959 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.494660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.0.0.1:40356)
0807 06:20:29.495740 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.495834 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":971}
W20260807 06:20:29.496845 16567 catalog_manager.cc:4584] TS 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b5df38823e046cc9d3caf4083283434: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38095: connect: Connection refused (error 111)
I20260807 06:20:29.502173 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 17048
I20260807 06:20:29.502398 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:29.502089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38769 (local address 127.0.0.1:50672)
0807 06:20:29.502215 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:29.502300 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.66:38769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 06:20:29.513135 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 16541
I20260807 06:20:49.524950 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--webserver_interface=127.26.252.126
--webserver_port=38285
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:20:49.652750 17308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:49.652998 17308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:49.653039 17308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:49.657035 17308 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:20:49.657085 17308 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:20:49.657101 17308 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:20:49.657116 17308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:20:49.657184 17308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:49.657218 17308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:49.657253 17308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:20:49.657292 17308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:20:49.662451 17308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=38285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:49.663533 17308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:49.664580 17308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:49.679214 17317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:49.679229 17319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:49.679317 17308 server_base.cc:1034] running on GCE node
W20260807 06:20:49.679217 17316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:49.680271 17308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:49.681540 17308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:49.682735 17308 hybrid_clock.cc:648] HybridClock initialized: now 1786083649682722 us; error 25 us; skew 500 ppm
Aug 07 06:20:49 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:49.691704 17308 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:20:49.692759 17308 webserver.cc:460] Webserver started at http://127.26.252.126:38285/ using document root <none> and password file <none>
I20260807 06:20:49.693361 17308 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:49.693442 17308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:49.698182 17308 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:49.700588 17329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:49.702001 17308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 06:20:49.702159 17308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "4999c86441584019976456f39bd24ebe"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "dd45a75f8d7ee46cab93b7505777779c"
server_key_iv: "c4e37c4728632a01f9848c91dd25b2a2"
server_key_version: "encryptionkey@0"
I20260807 06:20:49.702855 17308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:49.719370 17308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:49.722649 17308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:49.722856 17308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:49.730347 17308 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34787
I20260807 06:20:49.730671 17395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34787 every 8 connection(s)
I20260807 06:20:49.731602 17308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:20:49.733414 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 17308
I20260807 06:20:49.734004 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:38095
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=35397
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:49.737726 17396 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:20:49.739919 17396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap starting.
I20260807 06:20:49.759565 17396 log.cc:824] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:49.769555 17396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:49.770037 17396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap complete.
I20260807 06:20:49.774720 17396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:49.775161 17396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4999c86441584019976456f39bd24ebe, State: Initialized, Role: FOLLOWER
I20260807 06:20:49.775767 17396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:49.775905 17396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:20:49.776011 17396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:20:49.776155 17396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:20:49.778290 17396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:49.778683 17396 leader_election.cc:302] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4999c86441584019976456f39bd24ebe; no voters:
I20260807 06:20:49.779086 17396 leader_election.cc:288] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:20:49.779201 17401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:20:49.779431 17401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 LEADER]: Becoming Leader. State: Replica: 4999c86441584019976456f39bd24ebe, State: Running, Role: LEADER
I20260807 06:20:49.779942 17401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:20:49.780560 17396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:20:49.781544 17403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:20:49.781678 17403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:49.781613 17407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4999c86441584019976456f39bd24ebe. Latest consensus state: current_term: 2 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:20:49.781751 17407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:20:49.783264 17415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:20:49.788617 17415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:20:49.789369 17415 catalog_manager.cc:1259] Loaded cluster ID: ef6ef6c593ff4dd299b5afcedfe12f95
I20260807 06:20:49.789443 17415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:20:49.792300 17415 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:20:49.793277 17415 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Loaded TSK: 0
I20260807 06:20:49.819950 17415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Generated new TSK 1
I20260807 06:20:49.820273 17415 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:20:49.852941 17398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:49.853195 17398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:49.853237 17398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:49.857203 17398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:49.857259 17398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:49.857376 17398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:20:49.862488 17398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:38095
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=35397
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:49.863519 17398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:49.864559 17398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:49.874318 17446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:49.874313 17444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:49.874929 17398 server_base.cc:1034] running on GCE node
W20260807 06:20:49.874929 17443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:49.875386 17398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:49.876125 17398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:49.877326 17398 hybrid_clock.cc:648] HybridClock initialized: now 1786083649877303 us; error 41 us; skew 500 ppm
Aug 07 06:20:49 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:49.880304 17398 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:20:49.881310 17398 webserver.cc:460] Webserver started at http://127.26.252.65:35397/ using document root <none> and password file <none>
I20260807 06:20:49.881911 17398 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:49.882035 17398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:49.886305 17398 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:20:49.888773 17457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:49.890308 17398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:20:49.890512 17398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "b57b77c89acd520e449621f95cb0c5fc"
server_key_iv: "2a47307f1a493d4fcb70032c3204a822"
server_key_version: "encryptionkey@0"
I20260807 06:20:49.891185 17398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:49.935320 17398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:49.938879 17398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:49.939107 17398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:49.939819 17398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:49.940989 17466 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:20:49.946372 17398 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:20:49.946535 17398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260807 06:20:49.946635 17398 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:20:49.948575 17398 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:20:49.948657 17398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 06:20:49.948936 17466 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap starting.
I20260807 06:20:49.961061 17398 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38095
I20260807 06:20:49.961100 17609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38095 every 8 connection(s)
I20260807 06:20:49.962123 17398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:20:49.962957 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 17398
I20260807 06:20:49.963481 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:38769
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=46101
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:20:49.969990 17466 log.cc:824] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:20:49 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:49.981751 17466 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:20:49.982278 17466 tablet_bootstrap.cc:492] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap complete.
I20260807 06:20:49.984128 17466 ts_tablet_manager.cc:1397] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent bootstrapping tablet: real 0.035s user 0.024s sys 0.007s
I20260807 06:20:49.987530 17466 raft_consensus.cc:348] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:49.988171 17466 raft_consensus.cc:729] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22498bd0baf14047a00ddd9e7d3f56ab, State: Initialized, Role: FOLLOWER
I20260807 06:20:49.988767 17466 consensus_queue.cc:260] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:49.990087 17613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:49.964524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:59223)
0807 06:20:49.965526 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:49.965594 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:49.967142 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:49.969195 (+ 2053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:49.969209 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:49.969871 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:49.970690 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:49.970717 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:49.973046 (+ 2329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:49.973052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:49.974712 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:49.974727 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:49.976403 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:49.976411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:49.976727 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:49.978677 (+ 1950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:49.978706 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:49.981108 (+ 2402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:49.984693 (+ 3585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:49.984701 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:49.984716 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:49.985184 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:49.985728 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:49.985735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:49.985741 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:49.985955 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:49.986934 (+ 979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:49.986943 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:49.987271 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 06:20:49.987500 (+ 229us) client_negotiation.cc:240] Negotiation successful
0807 06:20:49.987913 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":1,"thread_start_us":169,"threads_started":1}
I20260807 06:20:49.991221 17466 ts_tablet_manager.cc:1428] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 06:20:49.992306 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:49.964530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:59223 (local address 127.26.252.126:34787)
0807 06:20:49.965154 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:49.965179 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:49.965739 (+ 560us) server_negotiation.cc:407] Connection header received
0807 06:20:49.967715 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:49.967735 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:49.968220 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:49.968624 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:49.970934 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:49.972821 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:49.974878 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:49.975892 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:49.976132 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:49.981366 (+ 5234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:49.981374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:49.981390 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:49.981427 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:49.984518 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:49.985357 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:49.985366 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:49.985377 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:49.985565 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:49.986092 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:49.986097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:49.986100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:49.986707 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:49.986862 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:49.990651 (+ 3789us) server_negotiation.cc:299] Negotiation successful
0807 06:20:49.991076 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":137,"threads_started":1}
I20260807 06:20:49.995730 17610 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:49.996001 17610 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:49.996845 17610 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
I20260807 06:20:50.000169 17351 ts_manager.cc:194] Registered new tserver with Master: 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:50.004896 17351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:59223
I20260807 06:20:50.008405 17610 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
Aug 07 06:20:50 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:20:50.019331 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.004275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.0.0.1:59544)
0807 06:20:50.004729 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.004786 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.004938 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.006078 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.006085 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.006624 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:50.006800 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.006810 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.008757 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.008760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.009934 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.009948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.010936 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.010940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.011084 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.011827 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:50.011844 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:50.013877 (+ 2033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:50.016694 (+ 2817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.016705 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.016712 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.017070 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.017467 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.017470 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.017472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.017629 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.018544 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:50.018552 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:50.018699 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.018869 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.019120 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":123,"threads_started":1}
I20260807 06:20:50.019527 17621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.005145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59544 (local address 127.26.252.65:38095)
0807 06:20:50.005503 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.005516 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.005543 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:20:50.005629 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.005634 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.005851 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.006985 (+ 1134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:50.007384 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.008595 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.010130 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.010773 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.011430 (+ 657us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.014057 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:50.014072 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:50.014089 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:50.014123 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:50.016546 (+ 2423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.017231 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.017238 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.017240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.017348 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.017778 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.017784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.017787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.018360 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:50.018586 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.019047 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.019286 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":113,"threads_started":1}
I20260807 06:20:50.021528 17518 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b5df38823e046cc9d3caf4083283434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:59544
I20260807 06:20:50.022543 17622 tablet_replica.cc:330] stopping tablet replica
I20260807 06:20:50.022872 17622 raft_consensus.cc:2229] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:50.023154 17622 raft_consensus.cc:2258] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:50.024176 17622 ts_tablet_manager.cc:1905] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:50.028072 17622 ts_tablet_manager.cc:1918] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:50.028177 17622 log.cc:1196] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal/wals/8b5df38823e046cc9d3caf4083283434
I20260807 06:20:50.028437 17622 ts_tablet_manager.cc:1939] T 8b5df38823e046cc9d3caf4083283434 P 22498bd0baf14047a00ddd9e7d3f56ab: Deleting consensus metadata
I20260807 06:20:50.030284 17331 catalog_manager.cc:4841] TS 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095): tablet 8b5df38823e046cc9d3caf4083283434 (table test-table [id=56961912b2fb4f67a508ff5784e56023]) successfully deleted
W20260807 06:20:50.115082 17614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:50.115386 17614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:50.115468 17614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:50.119406 17614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:50.119488 17614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:50.119578 17614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:20:50.124722 17614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:38769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=46101
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:50.125829 17614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:50.126874 17614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:50.136446 17632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:50.136454 17630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:50.136500 17629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:50.136927 17614 server_base.cc:1034] running on GCE node
I20260807 06:20:50.137334 17614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:50.137902 17614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:50.139055 17614 hybrid_clock.cc:648] HybridClock initialized: now 1786083650139040 us; error 34 us; skew 500 ppm
Aug 07 06:20:50 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:50.141733 17614 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:20:50.142627 17614 webserver.cc:460] Webserver started at http://127.26.252.66:46101/ using document root <none> and password file <none>
I20260807 06:20:50.143188 17614 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:50.143307 17614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:50.147073 17614 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 06:20:50.149116 17641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:50.150285 17614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:20:50.150462 17614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "d0739ca78b33dbf505fc15232edfe556"
server_key_iv: "7543e664573ada43de921bbea6bd4d70"
server_key_version: "encryptionkey@0"
I20260807 06:20:50.151006 17614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:50.164112 17614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:50.166981 17614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:50.167184 17614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:50.167788 17614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:50.168910 17650 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260807 06:20:50.173136 17650 ts_tablet_manager.cc:1852] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260807 06:20:50.173552 17650 ts_tablet_manager.cc:1905] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:50.178315 17650 ts_tablet_manager.cc:1918] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:50.178503 17650 log.cc:1196] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/8b5df38823e046cc9d3caf4083283434
I20260807 06:20:50.178902 17650 ts_tablet_manager.cc:1939] T 8b5df38823e046cc9d3caf4083283434 P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting consensus metadata
I20260807 06:20:50.179280 17614 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260807 06:20:50.179373 17614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.011s user 0.000s sys 0.000s
I20260807 06:20:50.179486 17614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:50.179529 17614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:50.189265 17614 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:38769
I20260807 06:20:50.189319 17798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:38769 every 8 connection(s)
I20260807 06:20:50.190148 17614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:20:50.196384 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 17614
I20260807 06:20:50.196911 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:42641
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=37607
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:20:50 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:50.204784 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.191995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:32973 (local address 127.26.252.126:34787)
0807 06:20:50.192145 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.192150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.193049 (+ 899us) server_negotiation.cc:407] Connection header received
0807 06:20:50.193910 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.193913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.193962 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.194036 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:50.195435 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.195988 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.197438 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.197874 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.198001 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.200611 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:50.200618 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:50.200624 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:50.200660 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:50.202481 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.203028 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.203034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.203039 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.203145 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.203507 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.203512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.203517 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.203785 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:50.203898 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.204384 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.204546 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:20:50.205457 17803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.192431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:32973)
0807 06:20:50.192895 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.192939 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.193722 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.194204 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.194210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.194679 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:50.195298 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.195313 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.196147 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.196153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.197297 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.197307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.198033 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.198036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.198178 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.198901 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:50.198918 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:50.200432 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:50.202602 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.202606 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.202618 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.202921 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.203254 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.203257 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.203258 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.203401 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.203904 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:50.203909 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:50.204131 (+ 222us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.204295 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.204540 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":114,"threads_started":1}
I20260807 06:20:50.206763 17799 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:50.207028 17799 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:50.207540 17799 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
I20260807 06:20:50.208731 17351 ts_manager.cc:194] Registered new tserver with Master: b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66:38769)
I20260807 06:20:50.209614 17351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:32973
W20260807 06:20:50.312681 17805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:20:50.312923 17805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:20:50.312964 17805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:20:50.316867 17805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:20:50.316920 17805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:20:50.316975 17805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:20:50.322154 17805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:42641
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=37607
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:20:50.323158 17805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:20:50.324105 17805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:20:50.333527 17810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:50.333608 17816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:20:50.333539 17812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:20:50.334120 17805 server_base.cc:1034] running on GCE node
I20260807 06:20:50.334589 17805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:20:50.335232 17805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:20:50.336432 17805 hybrid_clock.cc:648] HybridClock initialized: now 1786083650336417 us; error 25 us; skew 500 ppm
Aug 07 06:20:50 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:20:50.339262 17805 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:20:50.340094 17805 webserver.cc:460] Webserver started at http://127.26.252.67:37607/ using document root <none> and password file <none>
I20260807 06:20:50.340602 17805 fs_manager.cc:359] Metadata directory not provided
I20260807 06:20:50.340672 17805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:20:50.344516 17805 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:20:50.346720 17825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:50.348028 17805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:20:50.348129 17805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "3724160fd4b549c2b05a4fe43aa82a17"
format_stamp: "Formatted at 2026-08-07 06:20:29 on dist-test-slave-68xk"
server_key: "c03b785f782dffc73f52ebd96e8cab8f"
server_key_iv: "0e0e4ecc261bde8fef609bb56ec1d0eb"
server_key_version: "encryptionkey@0"
I20260807 06:20:50.348681 17805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:20:50.374670 17805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:20:50.377981 17805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:20:50.378193 17805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:20:50.378849 17805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:20:50.379671 17805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:20:50.379719 17805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:50.379801 17805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:20:50.379832 17805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:20:50.389274 17805 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42641
I20260807 06:20:50.389322 17987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42641 every 8 connection(s)
I20260807 06:20:50.390281 17805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:20:50.394896 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 17805
Aug 07 06:20:50 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:20:50.405596 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.395679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44948 (local address 127.26.252.126:34787)
0807 06:20:50.395952 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.395956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.396098 (+ 142us) server_negotiation.cc:407] Connection header received
0807 06:20:50.397058 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.397063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.397109 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.397207 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:50.397990 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.398743 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.399593 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.399840 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.399950 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.401505 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:50.401510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:50.401514 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:50.401546 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:50.403435 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.404023 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.404026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.404028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.404120 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.404529 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.404535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.404536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.404789 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:50.405022 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.405228 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.405407 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":207,"spinlock_wait_cycles":5504,"thread_start_us":111,"threads_started":1}
I20260807 06:20:50.405728 17612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.392236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:37415 (local address 127.26.252.126:34787)
0807 06:20:50.392408 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.392413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.393738 (+ 1325us) server_negotiation.cc:407] Connection header received
0807 06:20:50.394685 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.394689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.394763 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.394864 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:50.396291 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.396925 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.398068 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.398433 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.398537 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.401134 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:50.401138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:50.401141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:50.401169 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:50.402924 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.403615 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.403619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.403620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.403741 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.404147 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.404150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.404152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.404433 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:50.404531 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.405228 (+ 697us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.405505 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":114,"server-negotiator.queue_time_us":68,"spinlock_wait_cycles":1792}
I20260807 06:20:50.406800 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.392654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:37415)
0807 06:20:50.393570 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.393616 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.394434 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.395062 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.395069 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.395596 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:20:50.396170 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.396185 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.397095 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.397097 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.397978 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.397988 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.398578 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.398581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.398735 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.399367 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:20:50.399383 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:20:50.400960 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:20:50.403042 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.403049 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.403063 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.403417 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.403844 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:20:50.403846 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:20:50.403848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:20:50.404013 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:20:50.404579 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:20:50.404587 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:20:50.404909 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.405143 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.405487 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":544,"threads_started":1}
I20260807 06:20:50.407984 17988 heartbeater.cc:347] Connected to a master server at 127.26.252.126:34787
I20260807 06:20:50.408254 17988 heartbeater.cc:464] Registering TS with master...
I20260807 06:20:50.408700 17988 heartbeater.cc:511] Master 127.26.252.126:34787 requested a full tablet report, sending...
I20260807 06:20:50.409655 17349 ts_manager.cc:194] Registered new tserver with Master: 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641)
I20260807 06:20:50.410220 17349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:37415
I20260807 06:20:50.419400 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:20:50.423667 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.419991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44964 (local address 127.26.252.126:34787)
0807 06:20:50.420145 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.420149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.420343 (+ 194us) server_negotiation.cc:407] Connection header received
0807 06:20:50.420537 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.420539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.420651 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.420780 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:50.421026 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.421550 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.422459 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.422693 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.422806 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.423139 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:50.423262 (+ 123us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 06:20:50.423535 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44964: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 06:20:50.423722 17992 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44964: token expired
W20260807 06:20:50.424044 17239 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.252.126:34787)
I20260807 06:20:50.431384 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.424418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44978 (local address 127.26.252.126:34787)
0807 06:20:50.424540 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.424547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.424561 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:20:50.424702 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.424705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.424755 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.424837 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:20:50.425481 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.425959 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.426819 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.427035 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.427145 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.428429 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:20:50.428432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:20:50.428435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:20:50.428460 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:20:50.429684 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.430123 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.430126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.430128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.430212 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:20:50.430521 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:20:50.430525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:20:50.430526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:20:50.430700 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:20:50.430866 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.431101 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.431221 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:20:50.433687 17349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:20:50.436902 17349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:20:50.445333 17518 tablet_service.cc:1467] Processing CreateTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa (DEFAULT_TABLE table=test-table [id=702c45dff3424b4abaef014d1a988ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:50.446055 17518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d5e5842ae9471abb9815a9803d2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:50.449100 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.443786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38769 (local address 127.0.0.1:60172)
0807 06:20:50.443904 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.443922 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.444008 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.444921 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.444927 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.444949 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:50.445077 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.445083 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.446561 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.446566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.447489 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.447499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.448626 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.448630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.448768 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.448824 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.448885 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.448967 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:20:50.449229 17466 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap starting.
I20260807 06:20:50.449875 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.444083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42641 (local address 127.0.0.1:38954)
0807 06:20:50.444392 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.444407 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.444497 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.445661 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.445664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.445681 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:50.445812 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.445818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.447220 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.447223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.448278 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.448288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.449455 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.449459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.449566 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.449589 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.449673 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.449751 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":124,"threads_started":1}
I20260807 06:20:50.449949 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.444594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.26.252.67:42641)
0807 06:20:50.444992 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.445003 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.445027 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:20:50.445120 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.445125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.445310 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.445467 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:50.446051 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.447090 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.448415 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.449121 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.449236 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.449388 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.449725 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.449813 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":174,"threads_started":1}
I20260807 06:20:50.449935 18001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.444014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60172 (local address 127.26.252.66:38769)
0807 06:20:50.444356 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.444383 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.444403 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:20:50.444491 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.444497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.444732 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.445252 (+ 520us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:50.445433 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.446395 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.447633 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.448480 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.449504 (+ 1024us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.449605 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.449678 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.449781 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":160,"threads_started":1}
I20260807 06:20:50.450172 17466 tablet_bootstrap.cc:654] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:50.451928 17466 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: No bootstrap required, opened a new log
I20260807 06:20:50.451447 17709 tablet_service.cc:1467] Processing CreateTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa (DEFAULT_TABLE table=test-table [id=702c45dff3424b4abaef014d1a988ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:50.452024 17466 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:20:50.452497 17466 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.452584 17709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d5e5842ae9471abb9815a9803d2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:50.452620 17466 raft_consensus.cc:374] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:50.452657 17466 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22498bd0baf14047a00ddd9e7d3f56ab, State: Initialized, Role: FOLLOWER
I20260807 06:20:50.452796 17466 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.453442 17466 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 06:20:50.453099 17895 tablet_service.cc:1467] Processing CreateTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa (DEFAULT_TABLE table=test-table [id=702c45dff3424b4abaef014d1a988ba4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:20:50.454172 17895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d5e5842ae9471abb9815a9803d2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:20:50.457387 17650 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Bootstrap starting.
I20260807 06:20:50.459697 17650 tablet_bootstrap.cc:654] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:50.460613 17650 log.cc:824] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:50.462633 18006 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Bootstrap starting.
I20260807 06:20:50.462854 17650 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: No bootstrap required, opened a new log
I20260807 06:20:50.463033 17650 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
W20260807 06:20:50.463639 17611 tablet.cc:2369] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:20:50.465317 18006 tablet_bootstrap.cc:654] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Neither blocks nor log segments found. Creating new log.
I20260807 06:20:50.466189 18006 log.cc:824] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Log is configured to *not* fsync() on all Append() calls
I20260807 06:20:50.467123 17650 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.467409 17650 raft_consensus.cc:374] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:50.467484 17650 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8fc9bcb71d4425eab5bc17e03f2c0af, State: Initialized, Role: FOLLOWER
I20260807 06:20:50.467900 17650 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.468303 18006 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: No bootstrap required, opened a new log
I20260807 06:20:50.468500 18006 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:20:50.468569 17799 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
I20260807 06:20:50.468880 17650 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:20:50.471487 18006 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.471715 18006 raft_consensus.cc:374] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:20:50.471776 18006 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3724160fd4b549c2b05a4fe43aa82a17, State: Initialized, Role: FOLLOWER
I20260807 06:20:50.472234 18006 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.472847 17988 heartbeater.cc:503] Master 127.26.252.126:34787 was elected leader, sending a full tablet report...
I20260807 06:20:50.473115 18006 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 06:20:50.519254 18009 raft_consensus.cc:482] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:20:50.519513 18009 raft_consensus.cc:504] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.520933 18009 leader_election.cc:288] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641), 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:50.525178 17803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.521171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42641 (local address 127.26.252.66:43239)
0807 06:20:50.521360 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.521377 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.521459 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.522318 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.522321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.522338 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:50.522479 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.522485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.523242 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.523247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.524066 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.524075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.524728 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.524845 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.524862 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.524952 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.525025 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":22}
I20260807 06:20:50.525177 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.521959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:43239 (local address 127.26.252.67:42641)
0807 06:20:50.522097 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.522101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.522114 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:20:50.522162 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.522164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.522202 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.522304 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:50.522609 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.523120 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524204 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.524598 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524738 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.524790 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.524971 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.525041 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:20:50.525373 18012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.521428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.26.252.66:38503)
0807 06:20:50.521955 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.521971 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:20:50.522055 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:20:50.522616 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:20:50.522619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:20:50.522637 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:20:50.522764 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.522770 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.523484 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.523488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.524290 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:20:50.524298 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.524954 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:20:50.525069 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.525090 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 06:20:50.525157 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 06:20:50.525224 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":2,"thread_start_us":280,"threads_started":1}
I20260807 06:20:50.525364 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.522037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:38503 (local address 127.26.252.65:38095)
0807 06:20:50.522315 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.522319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.522331 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:20:50.522376 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.522378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.522485 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.522608 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:20:50.522875 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.523371 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524413 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.524834 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.524963 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.525126 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.525169 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.525240 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":117,"threads_started":1}
I20260807 06:20:50.525894 17923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3724160fd4b549c2b05a4fe43aa82a17" is_pre_election: true
I20260807 06:20:50.525971 17547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" is_pre_election: true
I20260807 06:20:50.526242 17923 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 0.
I20260807 06:20:50.526273 17547 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 0.
I20260807 06:20:50.526846 17643 leader_election.cc:302] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22498bd0baf14047a00ddd9e7d3f56ab, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters:
I20260807 06:20:50.527148 18009 raft_consensus.cc:2781] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:20:50.527272 18009 raft_consensus.cc:482] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:20:50.527334 18009 raft_consensus.cc:3037] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:50.528458 18009 raft_consensus.cc:504] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.528843 18009 leader_election.cc:288] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 election: Requested vote from peers 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641), 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:20:50.529177 17923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3724160fd4b549c2b05a4fe43aa82a17"
I20260807 06:20:50.529282 17547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
I20260807 06:20:50.529316 17923 raft_consensus.cc:3037] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:50.529452 17547 raft_consensus.cc:3037] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:20:50.530592 17923 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 1.
I20260807 06:20:50.530786 17547 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8fc9bcb71d4425eab5bc17e03f2c0af in term 1.
I20260807 06:20:50.530932 17646 leader_election.cc:302] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3724160fd4b549c2b05a4fe43aa82a17, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters:
I20260807 06:20:50.531105 18009 raft_consensus.cc:2781] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:20:50.531308 18009 raft_consensus.cc:686] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 LEADER]: Becoming Leader. State: Replica: b8fc9bcb71d4425eab5bc17e03f2c0af, State: Running, Role: LEADER
I20260807 06:20:50.531638 18009 consensus_queue.cc:237] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:20:50.534804 17349 catalog_manager.cc:5495] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af reported cstate change: term changed from 0 to 1, leader changed from <none> to b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66). New cstate: current_term: 1 leader_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } health_report { overall_health: UNKNOWN } } }
I20260807 06:20:50.548403 18001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.544937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.26.252.66:38769)
0807 06:20:50.545074 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 06:20:50.545077 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:20:50.545108 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:20:50.545260 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:20:50.545262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:20:50.545313 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:20:50.545396 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:20:50.545720 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.546226 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.547084 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:20:50.547298 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:20:50.547385 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:20:50.547628 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:20:50.548027 (+ 399us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:20:50.548115 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 06:20:50.548196 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 06:20:50.548248 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:20:50.554366 17923 raft_consensus.cc:1261] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Refusing update from remote peer b8fc9bcb71d4425eab5bc17e03f2c0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:50.554358 17547 raft_consensus.cc:1261] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Refusing update from remote peer b8fc9bcb71d4425eab5bc17e03f2c0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:20:50.555094 18009 consensus_queue.cc:1035] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:50.555275 18015 consensus_queue.cc:1035] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:20:50.560055 18018 mvcc.cc:205] Tried to move back new op lower bound from 7315798632663158784 to 7315798632580390912. Current Snapshot: MvccSnapshot[applied={T|T < 7315798632663158784}]
I20260807 06:20:50.564782 18019 mvcc.cc:205] Tried to move back new op lower bound from 7315798632663158784 to 7315798632580390912. Current Snapshot: MvccSnapshot[applied={T|T < 7315798632663158784}]
I20260807 06:20:50.569108 17349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:50.569278 17349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:20:50.571745 17349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Sending DeleteTablet for 3 replicas of tablet 00d5e5842ae9471abb9815a9803d2eaa
I20260807 06:20:50.572520 17518 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:50 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:59544
I20260807 06:20:50.572503 17895 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:50 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:38954
I20260807 06:20:50.572499 17709 tablet_service.cc:1514] Processing DeleteTablet for tablet 00d5e5842ae9471abb9815a9803d2eaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:20:50 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60172
I20260807 06:20:50.573078 18034 tablet_replica.cc:330] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: stopping tablet replica
I20260807 06:20:50.573220 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 17398
I20260807 06:20:50.581893 18034 raft_consensus.cc:2229] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:20:50.582351 18034 raft_consensus.cc:2258] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:50.584404 18034 ts_tablet_manager.cc:1905] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:20:50.586544 18035 tablet_replica.cc:330] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: stopping tablet replica
I20260807 06:20:50.586978 18035 raft_consensus.cc:2229] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:20:50.587472 18035 raft_consensus.cc:2258] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:20:50.588172 18034 ts_tablet_manager.cc:1918] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:20:50.588294 18034 log.cc:1196] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/00d5e5842ae9471abb9815a9803d2eaa
I20260807 06:20:50.588689 18034 ts_tablet_manager.cc:1939] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Deleting consensus metadata
I20260807 06:20:50.590178 17333 catalog_manager.cc:4841] TS 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641): tablet 00d5e5842ae9471abb9815a9803d2eaa (table test-table [id=702c45dff3424b4abaef014d1a988ba4]) successfully deleted
I20260807 06:20:50.591691 18035 ts_tablet_manager.cc:1905] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:20:50.591853 17331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:38095 (error 108)
I20260807 06:20:50.593191 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 17614
I20260807 06:20:50.593515 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.593100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.0.0.1:59552)
0807 06:20:50.593327 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.593409 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260807 06:20:50.593686 17331 catalog_manager.cc:4584] TS 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00d5e5842ae9471abb9815a9803d2eaa: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38095: connect: Connection refused (error 111)
I20260807 06:20:50.604725 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 17805
I20260807 06:20:50.605067 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:20:50.604692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38769 (local address 127.0.0.1:60196)
0807 06:20:50.604874 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:20:50.604945 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.66:38769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 06:20:50.618778 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 17308
I20260807 06:21:10.632692 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--webserver_interface=127.26.252.126
--webserver_port=38285
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:10.748865 18037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:10.749197 18037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:10.749282 18037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:10.753455 18037 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:21:10.753551 18037 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:21:10.753579 18037 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:21:10.753611 18037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:10.753654 18037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:10.753701 18037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:10.753758 18037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:10.753805 18037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:10.759243 18037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=38285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:10.760340 18037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:10.761389 18037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:10.770212 18045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:10.770363 18037 server_base.cc:1034] running on GCE node
W20260807 06:21:10.770289 18043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:10.770275 18047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:10.771111 18037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:10.772119 18037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:10.773293 18037 hybrid_clock.cc:648] HybridClock initialized: now 1786083670773262 us; error 43 us; skew 500 ppm
Aug 07 06:21:10 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083670, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:10.776499 18037 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:21:10.777379 18037 webserver.cc:460] Webserver started at http://127.26.252.126:38285/ using document root <none> and password file <none>
I20260807 06:21:10.777974 18037 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:10.778041 18037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:10.782114 18037 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:10.784441 18055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:10.785738 18037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 06:21:10.785885 18037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "4999c86441584019976456f39bd24ebe"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "dd45a75f8d7ee46cab93b7505777779c"
server_key_iv: "c4e37c4728632a01f9848c91dd25b2a2"
server_key_version: "encryptionkey@0"
I20260807 06:21:10.786509 18037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:10.819454 18037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:10.822670 18037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:10.822885 18037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:10.830190 18037 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34787
I20260807 06:21:10.830523 18134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34787 every 8 connection(s)
I20260807 06:21:10.831370 18037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:10.836072 18136 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:21:10.837870 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap starting.
I20260807 06:21:10.841150 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18037
I20260807 06:21:10.841624 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:38095
--local_ip_for_outbound_sockets=127.26.252.65
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=35397
--webserver_interface=127.26.252.65
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:21:10.857550 18136 log.cc:824] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:10.870133 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:21:10.870635 18136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Bootstrap complete.
I20260807 06:21:10.875206 18136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:21:10.875717 18136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4999c86441584019976456f39bd24ebe, State: Initialized, Role: FOLLOWER
I20260807 06:21:10.876263 18136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:21:10.876426 18136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:10.876528 18136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:10.876708 18136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:21:10.878903 18136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:21:10.879285 18136 leader_election.cc:302] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4999c86441584019976456f39bd24ebe; no voters:
I20260807 06:21:10.879701 18136 leader_election.cc:288] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:21:10.879801 18140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:21:10.880057 18140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [term 3 LEADER]: Becoming Leader. State: Replica: 4999c86441584019976456f39bd24ebe, State: Running, Role: LEADER
I20260807 06:21:10.880458 18140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } }
I20260807 06:21:10.881102 18136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:10.881595 18140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4999c86441584019976456f39bd24ebe. Latest consensus state: current_term: 3 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:21:10.881832 18140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:10.882004 18141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4999c86441584019976456f39bd24ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4999c86441584019976456f39bd24ebe" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34787 } } }
I20260807 06:21:10.882201 18141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:10.882325 18147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:10.888200 18147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:10.889058 18147 catalog_manager.cc:1259] Loaded cluster ID: ef6ef6c593ff4dd299b5afcedfe12f95
I20260807 06:21:10.889142 18147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:10.892076 18147 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:10.892949 18147 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Loaded TSK: 0
I20260807 06:21:10.893049 18147 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4999c86441584019976456f39bd24ebe: Loaded TSK: 1
F20260807 06:21:10.893913 18147 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f51043949ad google::LogMessage::Fail() at ??:0
@ 0x7f510439788a google::LogMessage::SendToLog() at ??:0
@ 0x7f51043944de google::LogMessage::Flush() at ??:0
@ 0x7f5104395a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f510705818d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5107050f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f510ecf97bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f510ecd399c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f510ecd4178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f510ed15df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f510ed3482b std::function<>::operator()() at ??:0
@ 0x7f510ecd3b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f510ecd4f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f510ecd1579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f510ed15640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f51065e63d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f51065e6c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f51065e83f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f51065d7512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5107c1b6db start_thread at ??:0
@ 0x7f5102e9261f clone at ??:0
W20260807 06:21:10.985234 18138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:10.985498 18138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:10.985544 18138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:10.989882 18138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:10.989928 18138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:10.990013 18138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:10.995808 18138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:38095
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=35397
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:10.996865 18138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:10.997839 18138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:11.009433 18207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:11.009856 18208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:11.010362 18211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:11.011009 18138 server_base.cc:1034] running on GCE node
I20260807 06:21:11.011590 18138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:11.012274 18138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:11.015565 18138 hybrid_clock.cc:648] HybridClock initialized: now 1786083671015528 us; error 50 us; skew 500 ppm
Aug 07 06:21:11 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:11.018649 18138 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:21:11.019675 18138 webserver.cc:460] Webserver started at http://127.26.252.65:35397/ using document root <none> and password file <none>
I20260807 06:21:11.020253 18138 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:11.020349 18138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:11.024479 18138 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:21:11.026903 18222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:11.028237 18138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:11.028378 18138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "22498bd0baf14047a00ddd9e7d3f56ab"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "b57b77c89acd520e449621f95cb0c5fc"
server_key_iv: "2a47307f1a493d4fcb70032c3204a822"
server_key_version: "encryptionkey@0"
I20260807 06:21:11.028909 18138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:11.052361 18138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:11.055800 18138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:11.056010 18138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:11.056631 18138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:11.057773 18230 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:21:11.063714 18138 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:21:11.063795 18138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260807 06:21:11.063897 18138 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:21:11.065594 18138 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:21:11.065665 18138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260807 06:21:11.065991 18230 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap starting.
I20260807 06:21:11.076673 18138 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38095
I20260807 06:21:11.077665 18138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:11.078665 18370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38095 every 8 connection(s)
I20260807 06:21:11.079998 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18138
I20260807 06:21:11.080530 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:38769
--local_ip_for_outbound_sockets=127.26.252.66
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=46101
--webserver_interface=127.26.252.66
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:21:11.091787 18230 log.cc:824] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:11.099085 18230 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:21:11.099500 18230 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Bootstrap complete.
I20260807 06:21:11.100710 18230 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent bootstrapping tablet: real 0.035s user 0.020s sys 0.010s
I20260807 06:21:11.103152 18230 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:11.103591 18230 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22498bd0baf14047a00ddd9e7d3f56ab, State: Initialized, Role: FOLLOWER
I20260807 06:21:11.104091 18230 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:11.105103 18230 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
W20260807 06:21:11.176231 18373 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:21:11.080011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:55075)
0807 06:21:11.081539 (+ 1528us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.081605 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:11.082886 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:11.175439 (+ 92553us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1268,"thread_start_us":165,"threads_started":1}
W20260807 06:21:11.176908 18371 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34787 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34787: Client connection negotiation failed: client connection to 127.26.252.126:34787: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:21:11.177711 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.177436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:37775)
0807 06:21:11.177573 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.177651 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:21:11.178558 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.178230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:45641)
0807 06:21:11.178383 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.178472 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 06:21:11.178769 18371 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:21:11.226181 18374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:11.226466 18374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:11.226513 18374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:11.230434 18374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:11.230479 18374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:11.230535 18374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:11.235702 18374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:38769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=46101
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:11.236681 18374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:11.237658 18374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:11.247525 18382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:11.247537 18381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:11.247537 18384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:11.247753 18374 server_base.cc:1034] running on GCE node
I20260807 06:21:11.248237 18374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:11.248903 18374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:11.250094 18374 hybrid_clock.cc:648] HybridClock initialized: now 1786083671250070 us; error 36 us; skew 500 ppm
Aug 07 06:21:11 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:11.253223 18374 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:21:11.254194 18374 webserver.cc:460] Webserver started at http://127.26.252.66:46101/ using document root <none> and password file <none>
I20260807 06:21:11.254899 18374 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:11.255009 18374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:11.259294 18374 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:21:11.261696 18397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:11.262987 18374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:21:11.263140 18374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
format_stamp: "Formatted at 2026-08-07 06:20:28 on dist-test-slave-68xk"
server_key: "d0739ca78b33dbf505fc15232edfe556"
server_key_iv: "7543e664573ada43de921bbea6bd4d70"
server_key_version: "encryptionkey@0"
I20260807 06:21:11.263729 18374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:11.276065 18374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:11.279057 18374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:11.279284 18374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:11.279855 18374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:11.280926 18407 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 06:21:11.285187 18374 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 06:21:11.285291 18374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260807 06:21:11.285383 18374 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 06:21:11.287320 18374 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 06:21:11.287400 18374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260807 06:21:11.287698 18407 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Bootstrap starting.
I20260807 06:21:11.294188 18407 log.cc:824] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:11.298970 18374 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:38769
I20260807 06:21:11.299014 18540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:38769 every 8 connection(s)
I20260807 06:21:11.299897 18374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:11.302372 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18374
I20260807 06:21:11.302397 18407 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:21:11.302896 18407 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Bootstrap complete.
I20260807 06:21:11.302928 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:42641
--local_ip_for_outbound_sockets=127.26.252.67
--tserver_master_addrs=127.26.252.126:34787
--webserver_port=37607
--webserver_interface=127.26.252.67
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:41851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:21:11.303272 18407 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.004s
I20260807 06:21:11.303701 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.302087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:38563)
0807 06:21:11.302678 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.302822 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":171,"threads_started":1}
W20260807 06:21:11.304159 18541 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34787 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34787: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
I20260807 06:21:11.304875 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.304577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:46165)
0807 06:21:11.304714 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.304789 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 06:21:11.305637 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.305382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:53601)
0807 06:21:11.305506 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.305563 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 06:21:11.305897 18541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:21:11.306963 18407 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:11.307403 18407 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8fc9bcb71d4425eab5bc17e03f2c0af, State: Initialized, Role: FOLLOWER
I20260807 06:21:11.307898 18407 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:11.308988 18407 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260807 06:21:11.309083 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.308826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:54109)
0807 06:21:11.308943 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.309004 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:21:11.310217 18549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.309452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:41649)
0807 06:21:11.309773 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.309843 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":89,"threads_started":1}
W20260807 06:21:11.417733 18545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:11.417989 18545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:11.418032 18545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:11.422123 18545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:11.422178 18545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:11.422235 18545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:11.427392 18545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:42641
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=37607
--tserver_master_addrs=127.26.252.126:34787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:11.428426 18545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:11.429447 18545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:11.439394 18554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:11.439455 18545 server_base.cc:1034] running on GCE node
W20260807 06:21:11.439425 18557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:11.439677 18559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:11.440062 18545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:11.440678 18545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:11.441874 18545 hybrid_clock.cc:648] HybridClock initialized: now 1786083671441861 us; error 25 us; skew 500 ppm
Aug 07 06:21:11 dist-test-slave-68xk krb5kdc[16521](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:11.444887 18545 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:21:11.445729 18545 webserver.cc:460] Webserver started at http://127.26.252.67:37607/ using document root <none> and password file <none>
I20260807 06:21:11.446295 18545 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:11.446388 18545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:11.450127 18545 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260807 06:21:11.452631 18573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:11.453827 18545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 06:21:11.453966 18545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "3724160fd4b549c2b05a4fe43aa82a17"
format_stamp: "Formatted at 2026-08-07 06:20:29 on dist-test-slave-68xk"
server_key: "c03b785f782dffc73f52ebd96e8cab8f"
server_key_iv: "0e0e4ecc261bde8fef609bb56ec1d0eb"
server_key_version: "encryptionkey@0"
I20260807 06:21:11.454562 18545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:11.464583 18545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:11.467428 18545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:11.467617 18545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:11.468225 18545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:11.469019 18545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:11.469094 18545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:11.469169 18545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:11.469213 18545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:11.478636 18545 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:42641
I20260807 06:21:11.478704 18723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:42641 every 8 connection(s)
I20260807 06:21:11.479663 18545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:11.482398 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18545
I20260807 06:21:11.483665 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.481736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:52223)
0807 06:21:11.482304 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.482909 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":117,"threads_started":1}
W20260807 06:21:11.484069 18724 heartbeater.cc:644] Failed to heartbeat to 127.26.252.126:34787 (0 consecutive failures): Network error: Failed to ping master at 127.26.252.126:34787: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
I20260807 06:21:11.484658 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.484436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:51717)
0807 06:21:11.484548 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.484603 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 06:21:11.485256 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:11.485036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:52243)
0807 06:21:11.485149 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:11.485205 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 06:21:11.485428 18724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:21:12.179908 18730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.179406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:35711)
0807 06:21:12.179696 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.179757 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":83,"threads_started":1}
I20260807 06:21:12.311290 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.310870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:47795)
0807 06:21:12.311117 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.311171 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":73,"threads_started":1}
I20260807 06:21:12.486364 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.485936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:38935)
0807 06:21:12.486182 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.486259 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
I20260807 06:21:12.839147 18735 raft_consensus.cc:482] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:12.839344 18735 raft_consensus.cc:504] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:12.840399 18735 leader_election.cc:288] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66:38769), 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641)
Aug 07 06:21:12 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.66@KRBTEST.COM
Aug 07 06:21:12 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.67@KRBTEST.COM
I20260807 06:21:12.856532 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.840686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:42641 (local address 127.26.252.65:38491)
0807 06:21:12.841536 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.841550 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:12.841654 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:12.843157 (+ 1503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:12.843160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:12.843392 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:12.844152 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:12.844174 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.846100 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.846104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:12.847673 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:12.847685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.848648 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.848652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:12.848971 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:12.849721 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:12.849750 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:12.852133 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:12.854385 (+ 2252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854389 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:12.854391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:12.854637 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:12.854997 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:12.855001 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:12.855003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:12.855091 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:12.855706 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:12.855709 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:12.855838 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 06:21:12.855992 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 06:21:12.856332 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":339,"spinlock_wait_cycles":8064,"thread_start_us":62,"threads_started":1}
I20260807 06:21:12.856580 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.840903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:38491 (local address 127.26.252.67:42641)
0807 06:21:12.841362 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:12.841393 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:12.841669 (+ 276us) server_negotiation.cc:407] Connection header received
0807 06:21:12.842521 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:12.842529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:12.842908 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:12.843194 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:12.844365 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.845932 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.847808 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.848515 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.848685 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:12.852366 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:12.852373 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:12.852388 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:12.852423 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:12.854259 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854767 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:12.854773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:12.854778 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:12.854898 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:12.855189 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:12.855192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:12.855194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:12.855559 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:12.855706 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:12.856121 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 06:21:12.856415 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":84,"threads_started":1}
I20260807 06:21:12.856653 18741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.841096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:49161 (local address 127.26.252.66:38769)
0807 06:21:12.841501 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:12.841511 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:12.841552 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:21:12.841868 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:12.841875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:12.842378 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:12.842769 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:12.844364 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.845932 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.847811 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.848515 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.848685 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:12.851956 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:12.851961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:12.851973 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:12.851999 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:12.853876 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854465 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:12.854471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:12.854475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:12.854592 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854949 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:12.854953 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:12.854955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:12.855360 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:12.855504 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:12.856119 (+ 615us) server_negotiation.cc:299] Negotiation successful
0807 06:21:12.856421 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":142,"threads_started":1}
I20260807 06:21:12.856637 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.840686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:38769 (local address 127.26.252.65:49161)
0807 06:21:12.841023 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.841041 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:12.841155 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:12.842827 (+ 1672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:12.842832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:12.843345 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:12.844152 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:12.844174 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.846100 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.846104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:12.847673 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:12.847685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:12.848648 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:12.848652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:12.848971 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:12.849745 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:12.849762 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:12.851744 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:12.854013 (+ 2269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:12.854031 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:12.854305 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:12.854697 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:12.854701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:12.854703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:12.854848 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:12.855490 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:12.855496 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:12.855815 (+ 319us) client_negotiation.cc:769] Sending connection context
0807 06:21:12.855994 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 06:21:12.856421 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":488,"spinlock_wait_cycles":14080,"thread_start_us":97,"threads_started":1}
I20260807 06:21:12.858628 18482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" is_pre_election: true
I20260807 06:21:12.858975 18482 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22498bd0baf14047a00ddd9e7d3f56ab in term 1.
W20260807 06:21:12.859853 18227 leader_election.cc:341] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641): Not found: Tablet not found: 00d5e5842ae9471abb9815a9803d2eaa
I20260807 06:21:12.859980 18227 leader_election.cc:302] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22498bd0baf14047a00ddd9e7d3f56ab, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters: 3724160fd4b549c2b05a4fe43aa82a17
I20260807 06:21:12.860299 18735 raft_consensus.cc:2781] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 06:21:12.860378 18735 raft_consensus.cc:482] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:12.860409 18735 raft_consensus.cc:3037] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:21:12.862589 18735 raft_consensus.cc:504] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:12.862987 18735 leader_election.cc:288] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 election: Requested vote from peers b8fc9bcb71d4425eab5bc17e03f2c0af (127.26.252.66:38769), 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641)
I20260807 06:21:12.863327 18482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00d5e5842ae9471abb9815a9803d2eaa" candidate_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af"
I20260807 06:21:12.863459 18482 raft_consensus.cc:3037] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 1 FOLLOWER]: Advancing to term 2
W20260807 06:21:12.863754 18227 leader_election.cc:341] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641): Not found: Tablet not found: 00d5e5842ae9471abb9815a9803d2eaa
I20260807 06:21:12.865487 18482 raft_consensus.cc:2454] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22498bd0baf14047a00ddd9e7d3f56ab in term 2.
I20260807 06:21:12.865818 18224 leader_election.cc:302] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22498bd0baf14047a00ddd9e7d3f56ab, b8fc9bcb71d4425eab5bc17e03f2c0af; no voters: 3724160fd4b549c2b05a4fe43aa82a17
I20260807 06:21:12.866025 18735 raft_consensus.cc:2781] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:21:12.866202 18735 raft_consensus.cc:686] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [term 2 LEADER]: Becoming Leader. State: Replica: 22498bd0baf14047a00ddd9e7d3f56ab, State: Running, Role: LEADER
I20260807 06:21:12.866580 18735 consensus_queue.cc:237] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:12.867053 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:12.866754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:35399)
0807 06:21:12.866929 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:12.866979 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260807 06:21:13.259066 18482 raft_consensus.cc:1261] T 00d5e5842ae9471abb9815a9803d2eaa P b8fc9bcb71d4425eab5bc17e03f2c0af [term 2 FOLLOWER]: Refusing update from remote peer 22498bd0baf14047a00ddd9e7d3f56ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 06:21:13.259971 18735 consensus_queue.cc:1035] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 06:21:13.260573 18227 consensus_peers.cc:487] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab -> Peer 3724160fd4b549c2b05a4fe43aa82a17 (127.26.252.67:42641): Couldn't send request to peer 3724160fd4b549c2b05a4fe43aa82a17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00d5e5842ae9471abb9815a9803d2eaa. This is attempt 1: this message will repeat every 5th retry.
I20260807 06:21:13.262445 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.261958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:44129)
0807 06:21:13.262206 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.262286 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":71,"threads_started":1}
I20260807 06:21:13.264986 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.264694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:40505)
0807 06:21:13.264840 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.264902 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 06:21:13.265627 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.265416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:50937)
0807 06:21:13.265522 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.265566 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 06:21:13.487576 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.487159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:34539)
0807 06:21:13.487420 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.487475 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":81,"threads_started":1}
I20260807 06:21:13.751030 18755 ts_tablet_manager.cc:927] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Initiating tablet copy from peer 22498bd0baf14047a00ddd9e7d3f56ab (127.26.252.65:38095)
I20260807 06:21:13.751780 18755 tablet_copy_client.cc:316] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: tablet copy: Beginning tablet copy session from remote peer at address 127.26.252.65:38095
Aug 07 06:21:13 dist-test-slave-68xk krb5kdc[16521](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083671, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.65@KRBTEST.COM
I20260807 06:21:13.762849 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.752328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38095 (local address 127.26.252.67:51083)
0807 06:21:13.752461 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.752493 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:13.752610 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:13.753288 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:13.753293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:13.753866 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:13.754000 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:13.754007 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:13.755081 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:13.755084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:13.755836 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:13.755847 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:13.756458 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:13.756461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:13.756549 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:13.757151 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:13.757165 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:13.758931 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:13.760945 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:13.760954 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:13.760961 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:13.761200 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:13.761575 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:13.761579 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:13.761581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:13.761673 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:13.762176 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:13.762182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:13.762317 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 06:21:13.762489 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 06:21:13.762667 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 06:21:13.762895 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.752493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:51083 (local address 127.26.252.65:38095)
0807 06:21:13.752811 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:13.752817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:13.752839 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:21:13.752885 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:13.752889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:13.753084 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:13.753264 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:13.754135 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:13.754942 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:13.755965 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:13.756332 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:13.756418 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:13.759090 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:13.759101 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:13.759113 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:13.759138 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:13.760735 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:13.761355 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:13.761361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:13.761363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:13.761476 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:13.761779 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:13.761784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:13.761786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:13.762044 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:13.762187 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:13.762577 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 06:21:13.762737 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":56,"threads_started":1}
I20260807 06:21:13.764209 18340 tablet_copy_service.cc:140] P 22498bd0baf14047a00ddd9e7d3f56ab: Received BeginTabletCopySession request for tablet 00d5e5842ae9471abb9815a9803d2eaa from peer 3724160fd4b549c2b05a4fe43aa82a17 ({username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:51083)
I20260807 06:21:13.764447 18340 tablet_copy_service.cc:161] P 22498bd0baf14047a00ddd9e7d3f56ab: Beginning new tablet copy session on tablet 00d5e5842ae9471abb9815a9803d2eaa from peer 3724160fd4b549c2b05a4fe43aa82a17 at {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:51083: session id = 3724160fd4b549c2b05a4fe43aa82a17-00d5e5842ae9471abb9815a9803d2eaa
I20260807 06:21:13.765831 18340 tablet_copy_source_session.cc:205] T 00d5e5842ae9471abb9815a9803d2eaa P 22498bd0baf14047a00ddd9e7d3f56ab: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:21:13.769958 18755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00d5e5842ae9471abb9815a9803d2eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:13.776950 18755 tablet_copy_client.cc:791] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: tablet copy: Starting download of 0 data blocks...
I20260807 06:21:13.777199 18755 tablet_copy_client.cc:655] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: tablet copy: Starting download of 1 WAL segments...
I20260807 06:21:13.778980 18755 tablet_copy_client.cc:531] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:21:13.780602 18755 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Bootstrap starting.
I20260807 06:21:13.785991 18755 log.cc:824] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:13.792376 18755 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:21:13.792706 18755 tablet_bootstrap.cc:492] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Bootstrap complete.
I20260807 06:21:13.793041 18755 ts_tablet_manager.cc:1397] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260807 06:21:13.795361 18755 raft_consensus.cc:348] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:13.795584 18755 raft_consensus.cc:729] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3724160fd4b549c2b05a4fe43aa82a17, State: Initialized, Role: FOLLOWER
I20260807 06:21:13.796020 18755 consensus_queue.cc:260] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8fc9bcb71d4425eab5bc17e03f2c0af" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 38769 } } peers { permanent_uuid: "3724160fd4b549c2b05a4fe43aa82a17" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 42641 } } peers { permanent_uuid: "22498bd0baf14047a00ddd9e7d3f56ab" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38095 } }
I20260807 06:21:13.797056 18755 ts_tablet_manager.cc:1428] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20260807 06:21:13.797256 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.796978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:59865)
0807 06:21:13.797102 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.797164 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 06:21:13.797837 18340 tablet_copy_service.cc:342] P 22498bd0baf14047a00ddd9e7d3f56ab: Request end of tablet copy session 3724160fd4b549c2b05a4fe43aa82a17-00d5e5842ae9471abb9815a9803d2eaa received from {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:51083
I20260807 06:21:13.797959 18340 tablet_copy_service.cc:433] P 22498bd0baf14047a00ddd9e7d3f56ab: ending tablet copy session 3724160fd4b549c2b05a4fe43aa82a17-00d5e5842ae9471abb9815a9803d2eaa on tablet 00d5e5842ae9471abb9815a9803d2eaa with peer 3724160fd4b549c2b05a4fe43aa82a17
I20260807 06:21:13.798010 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:13.797770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:55157)
0807 06:21:13.797889 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:13.797943 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 06:21:14.266391 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:14.265908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:45437)
0807 06:21:14.266191 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:14.266270 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
I20260807 06:21:14.266806 18765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:14.266362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:54465)
0807 06:21:14.266636 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:14.266692 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":128,"threads_started":1}
I20260807 06:21:14.334043 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:14.333732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:44307)
0807 06:21:14.333878 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:14.333950 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 06:21:14.334192 18661 raft_consensus.cc:1203] T 00d5e5842ae9471abb9815a9803d2eaa P 3724160fd4b549c2b05a4fe43aa82a17 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 06:21:14.335487 18770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:14.335113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:57555)
0807 06:21:14.335344 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:14.335395 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":76,"threads_started":1}
I20260807 06:21:15.268131 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:15.267620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:34595)
0807 06:21:15.267956 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:15.268028 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":83,"threads_started":1}
I20260807 06:21:15.335337 18773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:15.334877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:59197)
0807 06:21:15.335173 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:15.335238 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":120,"threads_started":1}
I20260807 06:21:15.336643 18774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:15.336199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:60327)
0807 06:21:15.336497 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:15.336554 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":94,"threads_started":1}
I20260807 06:21:16.269462 18777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:16.269037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:41249)
0807 06:21:16.269308 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:16.269364 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":97,"threads_started":1}
I20260807 06:21:16.336885 18778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:16.336424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:43923)
0807 06:21:16.336697 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:16.336752 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":101,"threads_started":1}
I20260807 06:21:16.337688 18778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:16.337411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:34971)
0807 06:21:16.337543 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:16.337627 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:21:16.337802 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:16.337356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:57031)
0807 06:21:16.337625 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:16.337676 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":91,"threads_started":1}
I20260807 06:21:17.270870 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:17.270388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:50053)
0807 06:21:17.270692 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:17.270769 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":83,"threads_started":1}
I20260807 06:21:17.338860 18782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:17.338404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:41801)
0807 06:21:17.338702 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:17.338764 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
I20260807 06:21:17.339217 18783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:17.338815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:44131)
0807 06:21:17.339073 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:17.339130 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
I20260807 06:21:18.272143 18786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:18.271704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:48213)
0807 06:21:18.271967 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:18.272032 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":77,"threads_started":1}
I20260807 06:21:18.340179 18787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:18.339710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:44815)
0807 06:21:18.339986 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:18.340039 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":112,"threads_started":1}
I20260807 06:21:18.340418 18788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:18.339970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:59011)
0807 06:21:18.340230 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:18.340285 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
I20260807 06:21:19.273393 18789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:19.272916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:38457)
0807 06:21:19.273232 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:19.273291 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":101,"threads_started":1}
I20260807 06:21:19.341557 18790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:19.341108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:53835)
0807 06:21:19.341401 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:19.341459 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":113,"threads_started":1}
I20260807 06:21:19.341722 18792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:19.341277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:50207)
0807 06:21:19.341524 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:19.341588 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260807 06:21:20.274633 18793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:20.274129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:45545)
0807 06:21:20.274474 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:20.274531 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":101,"threads_started":1}
I20260807 06:21:20.342864 18794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:20.342347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:39397)
0807 06:21:20.342671 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:20.342748 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":135,"threads_started":1}
I20260807 06:21:20.342955 18795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:20.342554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:47201)
0807 06:21:20.342813 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:20.342867 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":78,"threads_started":1}
I20260807 06:21:21.275851 18797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:21.275416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:49609)
0807 06:21:21.275674 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:21.275750 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":77,"threads_started":1}
I20260807 06:21:21.344259 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:21.343782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:41265)
0807 06:21:21.344080 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:21.344155 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":74,"threads_started":1}
I20260807 06:21:21.344301 18799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:21.343888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:42423)
0807 06:21:21.344151 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:21.344206 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":86,"threads_started":1}
I20260807 06:21:22.277266 18801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:22.276719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:46955)
0807 06:21:22.277094 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:22.277155 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":106,"threads_started":1}
I20260807 06:21:22.345680 18805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:22.345251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:54575)
0807 06:21:22.345507 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:22.345564 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":59,"threads_started":1}
I20260807 06:21:22.345762 18802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:22.345133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:59441)
0807 06:21:22.345545 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:22.345617 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":97,"threads_started":1}
I20260807 06:21:23.278578 18806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:23.278053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:53507)
0807 06:21:23.278327 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:23.278385 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
I20260807 06:21:23.347039 18808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:23.346570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:60413)
0807 06:21:23.346889 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:23.346941 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":97,"threads_started":1}
I20260807 06:21:23.347082 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:23.346561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:52167)
0807 06:21:23.346884 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:23.346955 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":102,"threads_started":1}
I20260807 06:21:24.279785 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:24.279344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:40149)
0807 06:21:24.279616 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:24.279678 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":91,"threads_started":1}
I20260807 06:21:24.348306 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:24.347886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:49051)
0807 06:21:24.348151 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:24.348206 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":95,"threads_started":1}
I20260807 06:21:24.348496 18810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:24.347886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:58209)
0807 06:21:24.348287 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:24.348354 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":97,"threads_started":1}
I20260807 06:21:25.281108 18812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:25.280612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:48473)
0807 06:21:25.280922 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:25.280978 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":116,"threads_started":1}
I20260807 06:21:25.349825 18814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:25.349232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:45017)
0807 06:21:25.349640 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:25.349721 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":111,"threads_started":1}
I20260807 06:21:25.349865 18813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:25.349222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:54147)
0807 06:21:25.349671 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:25.349757 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":111,"threads_started":1}
I20260807 06:21:26.282739 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:26.282131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.66:39261)
0807 06:21:26.282402 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:26.282512 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260807 06:21:26.351302 18816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:26.350718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.67:39271)
0807 06:21:26.351028 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:26.351172 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":99,"threads_started":1}
I20260807 06:21:26.351354 18818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:26.350927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34787 (local address 127.26.252.65:53815)
0807 06:21:26.351202 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:26.351267 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.126:34787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":103,"threads_started":1}
I20260807 06:21:26.487279 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 18138
I20260807 06:21:26.499337 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 18374
I20260807 06:21:26.510602 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 18545
2026-08-07T06:21:26Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59724 ms)
[----------] 30 tests from SecurityITest (252330 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:26 dist-test-slave-68xk krb5kdc[18821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:26 dist-test-slave-68xk krb5kdc[18821](info): set up 2 sockets
Aug 07 06:21:26 dist-test-slave-68xk krb5kdc[18821](info): commencing operation
krb5kdc: starting...
W20260807 06:21:27.777390 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:27 dist-test-slave-68xk krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:21:27.909268 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39509
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:39509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:28.024020 18839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:28.024334 18839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:28.024408 18839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:28.028544 18839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:28.028621 18839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:28.028673 18839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:28.028712 18839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:28.028743 18839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:28.034276 18839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:39509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:28.035383 18839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:28.036405 18839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:28.045521 18849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.045526 18847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.045804 18846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.045805 18839 server_base.cc:1034] running on GCE node
I20260807 06:21:28.046744 18839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:28.047866 18839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:28.049032 18839 hybrid_clock.cc:648] HybridClock initialized: now 1786083688049016 us; error 28 us; skew 500 ppm
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:28.051915 18839 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:21:28.052825 18839 webserver.cc:460] Webserver started at http://127.26.252.126:35441/ using document root <none> and password file <none>
I20260807 06:21:28.053402 18839 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:28.053496 18839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:28.053737 18839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:28.056133 18839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "f70311449e4a490589ed951d84e06b68"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "7ceabdfb82462b6c689cd86e2bfeb376"
server_key_iv: "139a60f065a07ca6cd40678389b6b890"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.056859 18839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "f70311449e4a490589ed951d84e06b68"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "7ceabdfb82462b6c689cd86e2bfeb376"
server_key_iv: "139a60f065a07ca6cd40678389b6b890"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.060631 18839 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:28.063092 18857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.064419 18839 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:28.064567 18839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "f70311449e4a490589ed951d84e06b68"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "7ceabdfb82462b6c689cd86e2bfeb376"
server_key_iv: "139a60f065a07ca6cd40678389b6b890"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.064682 18839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:28.077696 18839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:28.080806 18839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:28.081024 18839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:28.088653 18839 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:39509
I20260807 06:21:28.088656 18928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:39509 every 8 connection(s)
I20260807 06:21:28.089761 18839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:28.092825 18929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:28.096619 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18839
I20260807 06:21:28.096777 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:28.097056 27633 external_mini_cluster.cc:1428] Setting key 56c097d1a86c014642b6f24401d4995c
I20260807 06:21:28.099061 18929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: Bootstrap starting.
I20260807 06:21:28.101279 18929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:28.102036 18929 log.cc:824] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:28.103940 18929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: No bootstrap required, opened a new log
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:28.108244 18929 raft_consensus.cc:348] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } }
I20260807 06:21:28.108474 18929 raft_consensus.cc:374] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:28.108534 18929 raft_consensus.cc:729] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f70311449e4a490589ed951d84e06b68, State: Initialized, Role: FOLLOWER
I20260807 06:21:28.109027 18929 consensus_queue.cc:260] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } }
I20260807 06:21:28.109189 18929 raft_consensus.cc:388] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:28.109277 18929 raft_consensus.cc:482] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:28.109401 18929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:28.110284 18929 raft_consensus.cc:504] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } }
I20260807 06:21:28.110667 18929 leader_election.cc:302] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f70311449e4a490589ed951d84e06b68; no voters:
I20260807 06:21:28.111039 18929 leader_election.cc:288] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:28.111146 18935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:28.111358 18935 raft_consensus.cc:686] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [term 1 LEADER]: Becoming Leader. State: Replica: f70311449e4a490589ed951d84e06b68, State: Running, Role: LEADER
I20260807 06:21:28.111727 18935 consensus_queue.cc:237] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } }
I20260807 06:21:28.112063 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.098579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46944 (local address 127.26.252.126:39509)
0807 06:21:28.099031 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.099047 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.099082 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:21:28.099760 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.099786 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.100112 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.100451 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:28.101274 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.102399 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.103347 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.103820 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.103993 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.106836 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:28.106842 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:28.106854 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:28.106882 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:28.108691 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.109148 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.109154 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.109160 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.109330 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.109651 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.109655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.109657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.110073 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:28.110300 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.110637 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.110992 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":139,"threads_started":1}
I20260807 06:21:28.112455 18929 sys_catalog.cc:564] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:28.113912 18938 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f70311449e4a490589ed951d84e06b68. Latest consensus state: current_term: 1 leader_uuid: "f70311449e4a490589ed951d84e06b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } } }
I20260807 06:21:28.114035 18938 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:28.114864 18947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:28.114969 18936 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f70311449e4a490589ed951d84e06b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70311449e4a490589ed951d84e06b68" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39509 } } }
I20260807 06:21:28.115144 18936 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:28.117498 18947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:28.123016 18947 catalog_manager.cc:1347] Generated new cluster ID: 4c0b0e50a17f4bcc8f4c89bc186e5f8e
I20260807 06:21:28.123082 18947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:28.147746 18947 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:28.148705 18947 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:28.162431 18947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: Generated new TSK 0
I20260807 06:21:28.163177 18947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:21:28.197405 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:28.311038 18958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:28.311306 18958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:28.311352 18958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:28.315687 18958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:28.315748 18958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:28.315807 18958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:28.320988 18958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:28.321995 18958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:28.323084 18958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:28.332878 18966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.333076 18958 server_base.cc:1034] running on GCE node
W20260807 06:21:28.332896 18969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.332885 18965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.333652 18958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:28.334273 18958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:28.335434 18958 hybrid_clock.cc:648] HybridClock initialized: now 1786083688335410 us; error 41 us; skew 500 ppm
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:28.338207 18958 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:21:28.339147 18958 webserver.cc:460] Webserver started at http://127.26.252.65:33173/ using document root <none> and password file <none>
I20260807 06:21:28.339709 18958 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:28.339823 18958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:28.340054 18958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:28.342056 18958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "72e6c30b30d7471c8ba88a82d6f27894"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "cbb29f0c69626c102ebaf9311008f8ea"
server_key_iv: "7a6a462193e8aee813f79883353d868d"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.342669 18958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "72e6c30b30d7471c8ba88a82d6f27894"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "cbb29f0c69626c102ebaf9311008f8ea"
server_key_iv: "7a6a462193e8aee813f79883353d868d"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.346338 18958 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:21:28.348766 18977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.350030 18958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:28.350167 18958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "72e6c30b30d7471c8ba88a82d6f27894"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "cbb29f0c69626c102ebaf9311008f8ea"
server_key_iv: "7a6a462193e8aee813f79883353d868d"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.350276 18958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:28.362066 18958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:28.364980 18958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:28.365203 18958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:28.365789 18958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:28.366660 18958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:28.366732 18958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.366814 18958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:28.366859 18958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.376351 18958 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:42121
I20260807 06:21:28.376402 19129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:42121 every 8 connection(s)
I20260807 06:21:28.377264 18958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:28.384361 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 18958
I20260807 06:21:28.384509 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:28.384805 27633 external_mini_cluster.cc:1428] Setting key e198b5264348463a0490d31b3a22d2c0
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:28.392510 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.379234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:57085 (local address 127.26.252.126:39509)
0807 06:21:28.379401 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.379406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.380307 (+ 901us) server_negotiation.cc:407] Connection header received
0807 06:21:28.381691 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.381694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.381741 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.381819 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:28.383121 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.383669 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.385213 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.385459 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.385610 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.388394 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:28.388401 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:28.388407 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:28.388444 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:28.389915 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.390650 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.390652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.390654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.390734 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.391191 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.391193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.391195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.391392 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:28.391471 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.392244 (+ 773us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.392388 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:21:28.393872 19133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.379638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39509 (local address 127.26.252.65:57085)
0807 06:21:28.380124 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.380170 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.381484 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.381991 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.381998 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.382461 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:28.382978 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.382993 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.383809 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.383813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.385068 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.385080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.385663 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.385667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.385847 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.386531 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:28.386550 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:28.388175 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:28.390055 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.390065 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.390084 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.390539 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.390834 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.390840 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.390846 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.391091 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.391520 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:28.391531 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:28.391900 (+ 369us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.392188 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.392589 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":134,"threads_started":1}
I20260807 06:21:28.395394 19130 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39509
I20260807 06:21:28.395653 19130 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:28.396158 19130 heartbeater.cc:511] Master 127.26.252.126:39509 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:21:28.397724 18877 ts_manager.cc:194] Registered new tserver with Master: 72e6c30b30d7471c8ba88a82d6f27894 (127.26.252.65:42121)
I20260807 06:21:28.399032 18877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:57085
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:21:28.419011 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:28.534650 19136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:28.534927 19136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:28.535007 19136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:28.538944 19136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:28.539027 19136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:28.539120 19136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:28.544333 19136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:28.545408 19136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:28.546437 19136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:28.556210 19146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.556273 19143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.556274 19144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.556510 19136 server_base.cc:1034] running on GCE node
I20260807 06:21:28.557039 19136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:28.557703 19136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:28.558897 19136 hybrid_clock.cc:648] HybridClock initialized: now 1786083688558874 us; error 30 us; skew 500 ppm
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:28.561771 19136 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:21:28.562742 19136 webserver.cc:460] Webserver started at http://127.26.252.66:41187/ using document root <none> and password file <none>
I20260807 06:21:28.563277 19136 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:28.563339 19136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:28.563504 19136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:28.565500 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "b438ced18cff4fd2b60b30acc2ec46f9"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "0feee2578ce0df8a09e69b845f1b7ff3"
server_key_iv: "a709e9bbbe73a41ae31b3b2040fdd89a"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.566015 19136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "b438ced18cff4fd2b60b30acc2ec46f9"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "0feee2578ce0df8a09e69b845f1b7ff3"
server_key_iv: "a709e9bbbe73a41ae31b3b2040fdd89a"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.569905 19136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:21:28.572438 19155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.573830 19136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:21:28.573944 19136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "b438ced18cff4fd2b60b30acc2ec46f9"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "0feee2578ce0df8a09e69b845f1b7ff3"
server_key_iv: "a709e9bbbe73a41ae31b3b2040fdd89a"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.574119 19136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:28.599043 19136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:28.603102 19136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:28.603361 19136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:28.604010 19136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:28.604890 19136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:28.604941 19136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.604985 19136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:28.605001 19136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.614833 19136 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:45221
I20260807 06:21:28.614919 19314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:45221 every 8 connection(s)
I20260807 06:21:28.615839 19136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:28.616510 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 19136
I20260807 06:21:28.616643 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:28.616950 27633 external_mini_cluster.cc:1428] Setting key 25c4c87da6caf5a023ccb1ae753155d9
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:21:28.632427 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.617906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:52301 (local address 127.26.252.126:39509)
0807 06:21:28.618058 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.618063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.619086 (+ 1023us) server_negotiation.cc:407] Connection header received
0807 06:21:28.620566 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.620573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.620640 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.620756 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:28.622524 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.623138 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.625099 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.625322 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.625407 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.628461 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:28.628465 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:28.628467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:28.628512 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:28.630002 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.630704 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.630708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.630710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.630792 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.631185 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.631189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.631190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.631406 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:28.631519 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.632117 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.632246 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:21:28.633210 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.618360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39509 (local address 127.26.252.66:52301)
0807 06:21:28.618915 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.618970 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.620269 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.621021 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.621033 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.621562 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:28.622298 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.622322 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.623288 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.623292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.624933 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.624949 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.625500 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.625507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.625758 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.626455 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:28.626482 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:28.628286 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:28.630219 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.630226 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.630241 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.630586 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.630887 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.630891 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.630893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.631041 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.631520 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:28.631528 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:28.631853 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.632046 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.632375 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":150,"threads_started":1}
I20260807 06:21:28.634843 19315 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39509
I20260807 06:21:28.635123 19315 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:28.635651 19315 heartbeater.cc:511] Master 127.26.252.126:39509 requested a full tablet report, sending...
I20260807 06:21:28.636770 18877 ts_manager.cc:194] Registered new tserver with Master: b438ced18cff4fd2b60b30acc2ec46f9 (127.26.252.66:45221)
I20260807 06:21:28.637348 18877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:52301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:21:28.649230 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:28.766299 19321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:28.766619 19321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:28.766669 19321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:28.770781 19321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:28.770833 19321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:28.770888 19321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:28.776069 19321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:28.777031 19321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:28.778115 19321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:28.788065 19328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.788156 19321 server_base.cc:1034] running on GCE node
W20260807 06:21:28.788089 19330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:28.788069 19327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:28.788738 19321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:28.789386 19321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:28.790580 19321 hybrid_clock.cc:648] HybridClock initialized: now 1786083688790539 us; error 59 us; skew 500 ppm
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:28.793471 19321 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:21:28.794454 19321 webserver.cc:460] Webserver started at http://127.26.252.67:36731/ using document root <none> and password file <none>
I20260807 06:21:28.795104 19321 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:28.795226 19321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:28.795459 19321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:28.797559 19321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "11541fe97bed41018db6e648856bab3b"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "44608ba0545655c18669808bd2cae5ee"
server_key_iv: "6db347a7c21e5462a99fbf923e630ed8"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.798081 19321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "11541fe97bed41018db6e648856bab3b"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "44608ba0545655c18669808bd2cae5ee"
server_key_iv: "6db347a7c21e5462a99fbf923e630ed8"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.801890 19321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:21:28.804363 19340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.805606 19321 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:28.805707 19321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "11541fe97bed41018db6e648856bab3b"
format_stamp: "Formatted at 2026-08-07 06:21:28 on dist-test-slave-68xk"
server_key: "44608ba0545655c18669808bd2cae5ee"
server_key_iv: "6db347a7c21e5462a99fbf923e630ed8"
server_key_version: "encryptionkey@0"
I20260807 06:21:28.805794 19321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:28.836429 19321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:28.839411 19321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:28.839581 19321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:28.840140 19321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:28.840946 19321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:28.840993 19321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.841034 19321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:28.841050 19321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:28.850494 19321 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:39439
I20260807 06:21:28.850517 19502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:39439 every 8 connection(s)
I20260807 06:21:28.851415 19321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:28.856844 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 19321
I20260807 06:21:28.856992 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:28.857306 27633 external_mini_cluster.cc:1428] Setting key 6e4aa18a7e7c7febac43aaa1f8e0cfc4
Aug 07 06:21:28 dist-test-slave-68xk krb5kdc[18821](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:28.865399 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.853286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:51261 (local address 127.26.252.126:39509)
0807 06:21:28.853430 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.853433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.854324 (+ 891us) server_negotiation.cc:407] Connection header received
0807 06:21:28.855777 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.855780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.855839 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.855920 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:28.857071 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.857839 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.859321 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.859638 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.859735 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.862288 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:28.862291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:28.862293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:28.862316 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:28.863636 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.864097 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.864099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.864100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.864178 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.864486 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.864488 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.864489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.864650 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:28.864726 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.865180 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.865281 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:21:28.866277 19506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.853633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39509 (local address 127.26.252.67:51261)
0807 06:21:28.854139 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.854203 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.855552 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.856087 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.856094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.856436 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:28.856903 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.856916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.857997 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.858000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.859190 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.859201 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.859800 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.859803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.859945 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.860590 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:28.860607 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:28.862084 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:28.863743 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.863747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.863758 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.864009 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.864272 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:28.864274 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:28.864276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:28.864404 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:28.864739 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:28.864744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:28.864963 (+ 219us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.865129 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.865426 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":125,"threads_started":1}
I20260807 06:21:28.867460 19503 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39509
I20260807 06:21:28.867707 19503 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:28.868326 19503 heartbeater.cc:511] Master 127.26.252.126:39509 requested a full tablet report, sending...
I20260807 06:21:28.869478 18877 ts_manager.cc:194] Registered new tserver with Master: 11541fe97bed41018db6e648856bab3b (127.26.252.67:39439)
I20260807 06:21:28.870128 18877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:51261
I20260807 06:21:28.871728 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:28.882371 18933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.873954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46956 (local address 127.26.252.126:39509)
0807 06:21:28.874069 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.874073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.874311 (+ 238us) server_negotiation.cc:407] Connection header received
0807 06:21:28.874381 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.874384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.874487 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.874576 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:28.875417 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.875913 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.876910 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.877194 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.877295 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.879101 (+ 1806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:28.879104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:28.879106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:28.879134 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:28.880581 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.881041 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.881045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.881046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.881162 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:28.881438 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:28.881442 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:28.881443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:28.881689 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:28.881817 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.882075 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.882238 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:21:28.885638 18876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:28.888690 18876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:28.904575 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.899172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55574 (local address 127.26.252.65:42121)
0807 06:21:28.899563 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.899570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.899592 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:21:28.899685 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.899695 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.899892 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.900041 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:28.900300 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.901358 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.902936 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.903833 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.903961 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.904119 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.904282 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.904391 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":103,"threads_started":1}
I20260807 06:21:28.904578 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.898764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:45221 (local address 127.0.0.1:57256)
0807 06:21:28.899656 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.899669 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.899749 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.900434 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.900437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.900457 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:28.900548 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.900554 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.902210 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.902214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.903189 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.903197 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.904217 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.904222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.904310 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.904331 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.904396 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.904447 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":12,"thread_start_us":88,"threads_started":1}
I20260807 06:21:28.904579 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.898732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:42121 (local address 127.0.0.1:55574)
0807 06:21:28.899213 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.899226 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.899320 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.900034 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.900037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.900058 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:28.900168 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.900174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.901490 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.901493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.902761 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.902772 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.903976 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.903980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.904095 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.904134 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.904257 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.904411 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":21,"thread_start_us":115,"threads_started":1}
I20260807 06:21:28.905292 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.899276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57256 (local address 127.26.252.66:45221)
0807 06:21:28.899905 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.899917 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.899946 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:21:28.900044 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.900049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.900268 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.900452 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:28.900661 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.902045 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.903307 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.903870 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.904000 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.904149 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.905002 (+ 853us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.905128 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":125,"threads_started":1}
I20260807 06:21:28.905407 19520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.898006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:39439 (local address 127.0.0.1:36730)
0807 06:21:28.898435 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:28.898491 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:28.898636 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:28.899555 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:28.899562 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:28.899595 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:28.899743 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.899752 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.901318 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.901321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.902724 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:28.902736 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.904904 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.904908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:28.905001 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.905025 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:21:28.905198 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 06:21:28.905263 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":55,"thread_start_us":104,"threads_started":1}
I20260807 06:21:28.905854 19521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:28.898208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36730 (local address 127.26.252.67:39439)
0807 06:21:28.899020 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:28.899034 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:28.899061 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:21:28.899163 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:28.899168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:28.899396 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:28.899566 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:28.899876 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.901163 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.902865 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:28.903838 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:28.903960 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:28.904119 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:28.905610 (+ 1491us) server_negotiation.cc:299] Negotiation successful
0807 06:21:28.905719 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":154,"threads_started":1}
I20260807 06:21:28.908043 19041 tablet_service.cc:1467] Processing CreateTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 (DEFAULT_TABLE table=test-table [id=4dde951a76044fedb663c60d9048f39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:28.908125 19220 tablet_service.cc:1467] Processing CreateTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 (DEFAULT_TABLE table=test-table [id=4dde951a76044fedb663c60d9048f39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:28.908133 19406 tablet_service.cc:1467] Processing CreateTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 (DEFAULT_TABLE table=test-table [id=4dde951a76044fedb663c60d9048f39b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:28.909212 19406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128c4e6b7b9400bbf4ff0f026c58462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:28.909212 19220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128c4e6b7b9400bbf4ff0f026c58462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:28.909224 19041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4128c4e6b7b9400bbf4ff0f026c58462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:28.916348 19527 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Bootstrap starting.
I20260807 06:21:28.917347 19529 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Bootstrap starting.
I20260807 06:21:28.917870 19528 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Bootstrap starting.
I20260807 06:21:28.918912 19527 tablet_bootstrap.cc:654] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:28.919600 19529 tablet_bootstrap.cc:654] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:28.919914 19528 tablet_bootstrap.cc:654] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:28.919927 19527 log.cc:824] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:28.921061 19529 log.cc:824] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:28.921111 19528 log.cc:824] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:28.922071 19527 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: No bootstrap required, opened a new log
I20260807 06:21:28.922297 19527 ts_tablet_manager.cc:1397] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260807 06:21:28.923087 19528 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: No bootstrap required, opened a new log
I20260807 06:21:28.923276 19528 ts_tablet_manager.cc:1397] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260807 06:21:28.923545 19529 tablet_bootstrap.cc:492] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: No bootstrap required, opened a new log
I20260807 06:21:28.923722 19529 ts_tablet_manager.cc:1397] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 06:21:28.926782 19527 raft_consensus.cc:348] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.927062 19527 raft_consensus.cc:374] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:28.927143 19527 raft_consensus.cc:729] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72e6c30b30d7471c8ba88a82d6f27894, State: Initialized, Role: FOLLOWER
I20260807 06:21:28.927157 19528 raft_consensus.cc:348] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.927413 19528 raft_consensus.cc:374] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:28.927462 19528 raft_consensus.cc:729] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11541fe97bed41018db6e648856bab3b, State: Initialized, Role: FOLLOWER
I20260807 06:21:28.927536 19529 raft_consensus.cc:348] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.927690 19527 consensus_queue.cc:260] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.927850 19529 raft_consensus.cc:374] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:28.927928 19529 raft_consensus.cc:729] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b438ced18cff4fd2b60b30acc2ec46f9, State: Initialized, Role: FOLLOWER
I20260807 06:21:28.927997 19528 consensus_queue.cc:260] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.928377 19529 consensus_queue.cc:260] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:28.928442 19130 heartbeater.cc:503] Master 127.26.252.126:39509 was elected leader, sending a full tablet report...
I20260807 06:21:28.928710 19503 heartbeater.cc:503] Master 127.26.252.126:39509 was elected leader, sending a full tablet report...
I20260807 06:21:28.929077 19528 ts_tablet_manager.cc:1428] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260807 06:21:28.929378 19529 ts_tablet_manager.cc:1428] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 06:21:28.929767 19315 heartbeater.cc:503] Master 127.26.252.126:39509 was elected leader, sending a full tablet report...
I20260807 06:21:28.931061 19527 ts_tablet_manager.cc:1428] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
W20260807 06:21:29.102329 19504 tablet.cc:2369] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:29.117059 19316 tablet.cc:2369] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:29.128680 19132 tablet.cc:2369] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:29.236780 19533 raft_consensus.cc:482] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:29.237058 19533 raft_consensus.cc:504] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:29.238368 19533 leader_election.cc:288] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11541fe97bed41018db6e648856bab3b (127.26.252.67:39439), b438ced18cff4fd2b60b30acc2ec46f9 (127.26.252.66:45221)
I20260807 06:21:29.243165 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.239354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39363 (local address 127.26.252.66:45221)
0807 06:21:29.239543 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:29.239547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:29.239736 (+ 189us) server_negotiation.cc:407] Connection header received
0807 06:21:29.239873 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:29.239876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:29.239935 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:29.240025 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:29.240363 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.240880 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242082 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.242562 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242695 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.242750 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:29.242937 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 06:21:29.243027 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 06:21:29.243203 19521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.238825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:39663 (local address 127.26.252.67:39439)
0807 06:21:29.238992 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:29.238996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:29.239220 (+ 224us) server_negotiation.cc:407] Connection header received
0807 06:21:29.239517 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:29.239521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:29.239582 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:29.239688 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:29.240135 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.240787 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242089 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.242571 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242708 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.242761 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:29.243019 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 06:21:29.243096 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:21:29.243198 19540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.239239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:45221 (local address 127.26.252.65:39363)
0807 06:21:29.239597 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:29.239615 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:29.239757 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:29.240070 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:29.240075 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:29.240099 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:29.240230 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.240237 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.241024 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.241027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.241933 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.241943 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.242687 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.242795 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.242826 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:21:29.242890 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 06:21:29.242983 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":7,"thread_start_us":98,"threads_started":1}
I20260807 06:21:29.243582 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.238724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:39439 (local address 127.26.252.65:39663)
0807 06:21:29.239064 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:29.239083 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:29.239208 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:29.239751 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:29.239757 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:29.239790 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:29.239990 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.240002 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.240906 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.240912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.241937 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.241947 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.242721 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.242724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.242833 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.242852 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 06:21:29.243377 (+ 525us) client_negotiation.cc:240] Negotiation successful
0807 06:21:29.243463 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":94,"thread_start_us":142,"threads_started":1}
I20260807 06:21:29.243942 19246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128c4e6b7b9400bbf4ff0f026c58462" candidate_uuid: "72e6c30b30d7471c8ba88a82d6f27894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" is_pre_election: true
I20260807 06:21:29.244270 19246 raft_consensus.cc:2454] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e6c30b30d7471c8ba88a82d6f27894 in term 0.
I20260807 06:21:29.244256 19433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128c4e6b7b9400bbf4ff0f026c58462" candidate_uuid: "72e6c30b30d7471c8ba88a82d6f27894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11541fe97bed41018db6e648856bab3b" is_pre_election: true
I20260807 06:21:29.244524 19433 raft_consensus.cc:2454] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72e6c30b30d7471c8ba88a82d6f27894 in term 0.
I20260807 06:21:29.244771 18983 leader_election.cc:302] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72e6c30b30d7471c8ba88a82d6f27894, b438ced18cff4fd2b60b30acc2ec46f9; no voters:
I20260807 06:21:29.245067 19533 raft_consensus.cc:2781] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:29.245165 19533 raft_consensus.cc:482] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:29.245213 19533 raft_consensus.cc:3037] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:29.246287 19533 raft_consensus.cc:504] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:29.246702 19533 leader_election.cc:288] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [CANDIDATE]: Term 1 election: Requested vote from peers 11541fe97bed41018db6e648856bab3b (127.26.252.67:39439), b438ced18cff4fd2b60b30acc2ec46f9 (127.26.252.66:45221)
I20260807 06:21:29.247082 19433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128c4e6b7b9400bbf4ff0f026c58462" candidate_uuid: "72e6c30b30d7471c8ba88a82d6f27894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11541fe97bed41018db6e648856bab3b"
I20260807 06:21:29.247108 19246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4128c4e6b7b9400bbf4ff0f026c58462" candidate_uuid: "72e6c30b30d7471c8ba88a82d6f27894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b438ced18cff4fd2b60b30acc2ec46f9"
I20260807 06:21:29.247236 19433 raft_consensus.cc:3037] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:29.247251 19246 raft_consensus.cc:3037] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:29.248318 19246 raft_consensus.cc:2454] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e6c30b30d7471c8ba88a82d6f27894 in term 1.
I20260807 06:21:29.248325 19433 raft_consensus.cc:2454] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72e6c30b30d7471c8ba88a82d6f27894 in term 1.
I20260807 06:21:29.248610 18983 leader_election.cc:302] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11541fe97bed41018db6e648856bab3b, 72e6c30b30d7471c8ba88a82d6f27894; no voters:
I20260807 06:21:29.248811 19533 raft_consensus.cc:2781] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:29.249066 19533 raft_consensus.cc:686] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 1 LEADER]: Becoming Leader. State: Replica: 72e6c30b30d7471c8ba88a82d6f27894, State: Running, Role: LEADER
I20260807 06:21:29.249395 19533 consensus_queue.cc:237] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } }
I20260807 06:21:29.252746 18877 catalog_manager.cc:5495] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72e6c30b30d7471c8ba88a82d6f27894 (127.26.252.65). New cstate: current_term: 1 leader_uuid: "72e6c30b30d7471c8ba88a82d6f27894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72e6c30b30d7471c8ba88a82d6f27894" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 42121 } health_report { overall_health: HEALTHY } } }
I20260807 06:21:29.265445 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.262078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55588 (local address 127.26.252.65:42121)
0807 06:21:29.262241 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:29.262244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:29.262258 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:21:29.262356 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:29.262358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:29.262450 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:29.262551 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:29.262808 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.263323 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.264141 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.264352 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.264433 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.264693 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:29.265085 (+ 392us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:29.265177 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:29.265301 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 06:21:29.265347 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 06:21:29.271279 19433 raft_consensus.cc:1261] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 1 FOLLOWER]: Refusing update from remote peer 72e6c30b30d7471c8ba88a82d6f27894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:29.271279 19246 raft_consensus.cc:1261] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 1 FOLLOWER]: Refusing update from remote peer 72e6c30b30d7471c8ba88a82d6f27894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:29.272004 19533 consensus_queue.cc:1035] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11541fe97bed41018db6e648856bab3b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:29.272239 19541 consensus_queue.cc:1035] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b438ced18cff4fd2b60b30acc2ec46f9" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:29.279045 19547 mvcc.cc:205] Tried to move back new op lower bound from 7315798791247663104 to 7315798791167807488. Current Snapshot: MvccSnapshot[applied={T|T < 7315798791247663104}]
I20260807 06:21:29.279598 19550 mvcc.cc:205] Tried to move back new op lower bound from 7315798791247663104 to 7315798791167807488. Current Snapshot: MvccSnapshot[applied={T|T < 7315798791247663104}]
I20260807 06:21:29.287638 18877 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:29.287844 18877 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:29.290897 18877 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f70311449e4a490589ed951d84e06b68: Sending DeleteTablet for 3 replicas of tablet 4128c4e6b7b9400bbf4ff0f026c58462
I20260807 06:21:29.291688 19041 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:55574
I20260807 06:21:29.292105 19406 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:36730
I20260807 06:21:29.292241 19562 tablet_replica.cc:330] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894: stopping tablet replica
I20260807 06:21:29.292235 19220 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:57256
I20260807 06:21:29.292557 19562 raft_consensus.cc:2229] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:29.292562 19218 tablet_service.cc:1514] Processing DeleteTablet for tablet 4128c4e6b7b9400bbf4ff0f026c58462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:29 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:57256
I20260807 06:21:29.292898 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 18958
I20260807 06:21:29.292912 19562 raft_consensus.cc:2258] T 4128c4e6b7b9400bbf4ff0f026c58462 P 72e6c30b30d7471c8ba88a82d6f27894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:29.293017 19569 tablet_replica.cc:330] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: stopping tablet replica
I20260807 06:21:29.293308 19569 raft_consensus.cc:2229] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:29.293723 19569 raft_consensus.cc:2258] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:29.294153 19568 tablet_replica.cc:330] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: stopping tablet replica
I20260807 06:21:29.294560 19568 raft_consensus.cc:2229] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:29.294925 19568 raft_consensus.cc:2258] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:29.302127 19569 ts_tablet_manager.cc:1905] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:29.302117 19568 ts_tablet_manager.cc:1905] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:29.304983 19569 ts_tablet_manager.cc:1918] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:29.304983 19568 ts_tablet_manager.cc:1918] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:29.305114 19568 log.cc:1196] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/4128c4e6b7b9400bbf4ff0f026c58462
I20260807 06:21:29.305114 19569 log.cc:1196] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/4128c4e6b7b9400bbf4ff0f026c58462
I20260807 06:21:29.305466 19568 ts_tablet_manager.cc:1939] T 4128c4e6b7b9400bbf4ff0f026c58462 P 11541fe97bed41018db6e648856bab3b: Deleting consensus metadata
I20260807 06:21:29.305495 19569 ts_tablet_manager.cc:1939] T 4128c4e6b7b9400bbf4ff0f026c58462 P b438ced18cff4fd2b60b30acc2ec46f9: Deleting consensus metadata
I20260807 06:21:29.306838 18861 catalog_manager.cc:4841] TS b438ced18cff4fd2b60b30acc2ec46f9 (127.26.252.66:45221): tablet 4128c4e6b7b9400bbf4ff0f026c58462 (table test-table [id=4dde951a76044fedb663c60d9048f39b]) successfully deleted
I20260807 06:21:29.307072 18861 catalog_manager.cc:4841] TS 11541fe97bed41018db6e648856bab3b (127.26.252.67:39439): tablet 4128c4e6b7b9400bbf4ff0f026c58462 (table test-table [id=4dde951a76044fedb663c60d9048f39b]) successfully deleted
W20260807 06:21:29.307335 18861 catalog_manager.cc:4808] TS b438ced18cff4fd2b60b30acc2ec46f9 (127.26.252.66:45221): delete failed for tablet 4128c4e6b7b9400bbf4ff0f026c58462 because the tablet was not found. No further retry: Not found: Tablet not found: 4128c4e6b7b9400bbf4ff0f026c58462
W20260807 06:21:29.308602 18858 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:42121 (error 108)
I20260807 06:21:29.308913 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 19136
I20260807 06:21:29.312760 19520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.312408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:42121 (local address 127.0.0.1:55602)
0807 06:21:29.312563 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:29.312634 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:42121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 06:21:29.312987 18858 catalog_manager.cc:4584] TS 72e6c30b30d7471c8ba88a82d6f27894 (127.26.252.65:42121): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4128c4e6b7b9400bbf4ff0f026c58462: Network error: Client connection negotiation failed: client connection to 127.26.252.65:42121: connect: Connection refused (error 111)
I20260807 06:21:29.331202 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 19321
I20260807 06:21:29.345402 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 18839
2026-08-07T06:21:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2837 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T06:21:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:29Z Disabled control of system clock
I20260807 06:21:29.384541 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:37339
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:37339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:29.499640 19577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:29.499943 19577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:29.499981 19577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:29.503908 19577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:29.503962 19577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:29.503978 19577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:29.503996 19577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:29.504011 19577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:29.508653 19577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:37339
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:37339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:29.509642 19577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:29.511103 19577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:29.519567 19583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.519583 19587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.519577 19584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:29.519845 19577 server_base.cc:1034] running on GCE node
I20260807 06:21:29.520421 19577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:29.521498 19577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:29.522698 19577 hybrid_clock.cc:648] HybridClock initialized: now 1786083689522675 us; error 32 us; skew 500 ppm
I20260807 06:21:29.524684 19577 webserver.cc:460] Webserver started at http://127.26.252.126:41763/ using document root <none> and password file <none>
I20260807 06:21:29.525278 19577 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:29.525375 19577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:29.525624 19577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:29.527696 19577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "67a017c6ff5c480196a2f57eb49a479d"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "1f8e02a853ae90b05e5098a8f74340cd"
server_key_iv: "faface8f6ecd25899c1f07f0ff04279f"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.528290 19577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "67a017c6ff5c480196a2f57eb49a479d"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "1f8e02a853ae90b05e5098a8f74340cd"
server_key_iv: "faface8f6ecd25899c1f07f0ff04279f"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.532464 19577 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:29.535142 19598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:29.536428 19577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:29.536588 19577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "67a017c6ff5c480196a2f57eb49a479d"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "1f8e02a853ae90b05e5098a8f74340cd"
server_key_iv: "faface8f6ecd25899c1f07f0ff04279f"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.536708 19577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:29.559051 19577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:29.559796 19577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:29.560021 19577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:29.567462 19577 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:37339
I20260807 06:21:29.567477 19668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:37339 every 8 connection(s)
I20260807 06:21:29.568445 19577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:29.570931 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 19577
I20260807 06:21:29.571064 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:29.571390 27633 external_mini_cluster.cc:1428] Setting key 35a428827984ba9a747ab282dd696ae7
I20260807 06:21:29.571796 19670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:29.578258 19670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: Bootstrap starting.
I20260807 06:21:29.580662 19670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:29.581063 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.572865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.26.252.126:37339)
0807 06:21:29.573585 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:29.573602 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:29.573639 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:21:29.574551 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:29.574570 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:29.575025 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:29.575365 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:29.575798 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.576750 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.577680 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.578156 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.578335 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.579298 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:29.579304 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:29.579316 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:29.579696 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:29.579752 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:29.579786 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:29.579901 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:29.580017 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 06:21:29.580279 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":159,"threads_started":1}
I20260807 06:21:29.581528 19670 log.cc:824] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:29.583830 19670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: No bootstrap required, opened a new log
I20260807 06:21:29.587415 19670 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } }
I20260807 06:21:29.587634 19670 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:29.587669 19670 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67a017c6ff5c480196a2f57eb49a479d, State: Initialized, Role: FOLLOWER
I20260807 06:21:29.588093 19670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } }
I20260807 06:21:29.588220 19670 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:29.588272 19670 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:29.588343 19670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:29.589347 19670 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } }
I20260807 06:21:29.589695 19670 leader_election.cc:302] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67a017c6ff5c480196a2f57eb49a479d; no voters:
I20260807 06:21:29.590054 19670 leader_election.cc:288] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:29.590243 19678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:29.590546 19678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [term 1 LEADER]: Becoming Leader. State: Replica: 67a017c6ff5c480196a2f57eb49a479d, State: Running, Role: LEADER
I20260807 06:21:29.590873 19678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } }
I20260807 06:21:29.591346 19670 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:29.592588 19681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67a017c6ff5c480196a2f57eb49a479d. Latest consensus state: current_term: 1 leader_uuid: "67a017c6ff5c480196a2f57eb49a479d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } } }
I20260807 06:21:29.592721 19681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:29.592983 19679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67a017c6ff5c480196a2f57eb49a479d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67a017c6ff5c480196a2f57eb49a479d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 37339 } } }
I20260807 06:21:29.593077 19679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:29.593223 19689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:29.596463 19689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:29.602537 19689 catalog_manager.cc:1347] Generated new cluster ID: 99d89324b9bb45b7a4a5537e5cceb503
I20260807 06:21:29.602619 19689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:29.627885 19689 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:29.629010 19689 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:29.634177 19689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: Generated new TSK 0
I20260807 06:21:29.634878 19689 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:29.641600 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--builtin_ntp_servers=127.26.252.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:29.767439 19702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:29.767707 19702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:29.767746 19702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:29.771878 19702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:29.771934 19702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:29.772015 19702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:29.776795 19702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:29.777909 19702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:29.779402 19702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:29.789328 19712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.789343 19715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.789361 19711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:29.789599 19702 server_base.cc:1034] running on GCE node
I20260807 06:21:29.789997 19702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:29.790741 19702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:29.791960 19702 hybrid_clock.cc:648] HybridClock initialized: now 1786083689791949 us; error 32 us; skew 500 ppm
I20260807 06:21:29.794623 19702 webserver.cc:460] Webserver started at http://127.26.252.65:33247/ using document root <none> and password file <none>
I20260807 06:21:29.795212 19702 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:29.795274 19702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:29.795500 19702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:29.797648 19702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "0e62cf1e0ef24580838cb31eb16f6656"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "d761437ff7ee83543473da0261b8ddb9"
server_key_iv: "8d7828f53269ecd3f1353349ad63ff48"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.798285 19702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "0e62cf1e0ef24580838cb31eb16f6656"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "d761437ff7ee83543473da0261b8ddb9"
server_key_iv: "8d7828f53269ecd3f1353349ad63ff48"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.801898 19702 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:21:29.804436 19725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:29.805668 19702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:29.805812 19702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "0e62cf1e0ef24580838cb31eb16f6656"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "d761437ff7ee83543473da0261b8ddb9"
server_key_iv: "8d7828f53269ecd3f1353349ad63ff48"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.805922 19702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:29.830693 19702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:29.831460 19702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:29.831692 19702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:29.832376 19702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:29.833421 19702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:29.833508 19702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:29.833585 19702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:29.833644 19702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:29.843422 19702 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38745
I20260807 06:21:29.843461 19872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38745 every 8 connection(s)
I20260807 06:21:29.844347 19702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:29.850487 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 19702
I20260807 06:21:29.850626 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:29.850936 27633 external_mini_cluster.cc:1428] Setting key fd4b6955ddc4a97e1e59f0284b92f793
I20260807 06:21:29.852882 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--builtin_ntp_servers=127.26.252.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:29.853713 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.846190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:51377 (local address 127.26.252.126:37339)
0807 06:21:29.846365 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:29.846370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:29.847417 (+ 1047us) server_negotiation.cc:407] Connection header received
0807 06:21:29.848735 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:29.848737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:29.848790 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:29.848863 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:29.849697 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.850225 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.851611 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.851844 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.851958 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.853082 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:29.853088 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:29.853103 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:29.853120 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:29.853148 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:29.853161 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:29.853245 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:29.853408 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 06:21:29.853500 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:21:29.854395 19875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:29.846621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:37339 (local address 127.26.252.65:51377)
0807 06:21:29.847271 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:29.847310 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:29.848540 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:29.849024 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:29.849031 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:29.849112 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:29.849569 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.849580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.850362 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.850371 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.851480 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:29.851490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:29.852000 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:29.852004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:29.852165 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:29.852783 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:29.852785 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:29.852825 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:29.852884 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:29.853262 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:29.853270 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:29.853274 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 06:21:29.853373 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:21:29.853583 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":121,"threads_started":1}
I20260807 06:21:29.855685 19873 heartbeater.cc:347] Connected to a master server at 127.26.252.126:37339
I20260807 06:21:29.855940 19873 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:29.856482 19873 heartbeater.cc:511] Master 127.26.252.126:37339 requested a full tablet report, sending...
I20260807 06:21:29.857883 19623 ts_manager.cc:194] Registered new tserver with Master: 0e62cf1e0ef24580838cb31eb16f6656 (127.26.252.65:38745)
I20260807 06:21:29.859149 19623 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.65:51377
W20260807 06:21:29.967267 19876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:29.967515 19876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:29.967552 19876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:29.971573 19876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:29.971629 19876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:29.971719 19876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:29.976506 19876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:29.977527 19876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:29.978912 19876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:29.988490 19886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.988521 19884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:29.988530 19883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:29.988600 19876 server_base.cc:1034] running on GCE node
I20260807 06:21:29.989051 19876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:29.989681 19876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:29.990880 19876 hybrid_clock.cc:648] HybridClock initialized: now 1786083689990868 us; error 31 us; skew 500 ppm
I20260807 06:21:29.992935 19876 webserver.cc:460] Webserver started at http://127.26.252.66:36651/ using document root <none> and password file <none>
I20260807 06:21:29.993551 19876 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:29.993618 19876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:29.993841 19876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:29.996022 19876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "a98308d95b127d55e94550b8f53c2d3d"
server_key_iv: "3ea4cdecca4d4c54076a3a71fa58d432"
server_key_version: "encryptionkey@0"
I20260807 06:21:29.996599 19876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "a98308d95b127d55e94550b8f53c2d3d"
server_key_iv: "3ea4cdecca4d4c54076a3a71fa58d432"
server_key_version: "encryptionkey@0"
I20260807 06:21:30.000370 19876 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:21:30.003122 19893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.004377 19876 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:30.004519 19876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09"
format_stamp: "Formatted at 2026-08-07 06:21:29 on dist-test-slave-68xk"
server_key: "a98308d95b127d55e94550b8f53c2d3d"
server_key_iv: "3ea4cdecca4d4c54076a3a71fa58d432"
server_key_version: "encryptionkey@0"
I20260807 06:21:30.004648 19876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:30.024295 19876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:30.025035 19876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:30.025272 19876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:30.025913 19876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:30.027110 19876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:30.027163 19876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.027202 19876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:30.027262 19876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.036712 19876 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:36365
I20260807 06:21:30.036741 20049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:36365 every 8 connection(s)
I20260807 06:21:30.037657 19876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:30.041623 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 19876
I20260807 06:21:30.041783 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:30.042160 27633 external_mini_cluster.cc:1428] Setting key 83a922f37138577fc36f7a92df160717
I20260807 06:21:30.044242 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--builtin_ntp_servers=127.26.252.84:41349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:30.048559 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.039522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:49357 (local address 127.26.252.126:37339)
0807 06:21:30.039696 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.039701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.040772 (+ 1071us) server_negotiation.cc:407] Connection header received
0807 06:21:30.042572 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.042577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.042640 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.042697 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:30.043895 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.044523 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.046309 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.046747 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.046873 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.047968 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:30.047975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:30.047981 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:30.047999 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:30.048026 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:30.048039 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:30.048124 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.048270 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.048344 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:21:30.049358 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.039935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:37339 (local address 127.26.252.66:49357)
0807 06:21:30.040613 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.040672 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.042281 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.043019 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.043026 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.043111 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:30.043742 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.043764 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.044665 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.044671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.046160 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.046175 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.046903 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.046906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.047048 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.047706 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:30.047708 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:30.047747 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:30.047809 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:30.048130 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:30.048136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:30.048141 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.048234 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.048450 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":134,"threads_started":1}
I20260807 06:21:30.050560 20050 heartbeater.cc:347] Connected to a master server at 127.26.252.126:37339
I20260807 06:21:30.050786 20050 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:30.051301 20050 heartbeater.cc:511] Master 127.26.252.126:37339 requested a full tablet report, sending...
I20260807 06:21:30.052343 19623 ts_manager.cc:194] Registered new tserver with Master: 2c1f6666f9c34b6faa0ea6e8f4da9e09 (127.26.252.66:36365)
I20260807 06:21:30.052917 19623 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.66:49357
W20260807 06:21:30.162703 20054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:30.162948 20054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:30.162985 20054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:30.166971 20054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:30.167019 20054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:30.167109 20054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:30.171873 20054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:41349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:30.172899 20054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:30.174299 20054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:30.184276 20063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:30.184288 20067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:30.184584 20054 server_base.cc:1034] running on GCE node
W20260807 06:21:30.184854 20061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:30.185278 20054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:30.185940 20054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:30.187099 20054 hybrid_clock.cc:648] HybridClock initialized: now 1786083690187063 us; error 51 us; skew 500 ppm
I20260807 06:21:30.192864 20054 webserver.cc:460] Webserver started at http://127.26.252.67:46377/ using document root <none> and password file <none>
I20260807 06:21:30.193490 20054 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:30.193595 20054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:30.193851 20054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:30.196070 20054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "91877d1852a34cb1ba76888969204219"
format_stamp: "Formatted at 2026-08-07 06:21:30 on dist-test-slave-68xk"
server_key: "6da5edd4195899a79946c39fa711075e"
server_key_iv: "34dbda18006b33838162cbed761a7f92"
server_key_version: "encryptionkey@0"
I20260807 06:21:30.196645 20054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "91877d1852a34cb1ba76888969204219"
format_stamp: "Formatted at 2026-08-07 06:21:30 on dist-test-slave-68xk"
server_key: "6da5edd4195899a79946c39fa711075e"
server_key_iv: "34dbda18006b33838162cbed761a7f92"
server_key_version: "encryptionkey@0"
I20260807 06:21:30.200455 20054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:30.202965 20077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.204304 20054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:30.204448 20054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "91877d1852a34cb1ba76888969204219"
format_stamp: "Formatted at 2026-08-07 06:21:30 on dist-test-slave-68xk"
server_key: "6da5edd4195899a79946c39fa711075e"
server_key_iv: "34dbda18006b33838162cbed761a7f92"
server_key_version: "encryptionkey@0"
I20260807 06:21:30.204558 20054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:30.215189 20054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:30.215801 20054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:30.215996 20054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:30.216596 20054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:30.217512 20054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:30.217561 20054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.217626 20054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:30.217670 20054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:30.230731 20054 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:40043
I20260807 06:21:30.230862 20231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:40043 every 8 connection(s)
I20260807 06:21:30.232072 20054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:30.242367 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 20054
I20260807 06:21:30.242514 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:30.242908 27633 external_mini_cluster.cc:1428] Setting key 478fc7fe3372b38db36ce9b58d3b2d74
I20260807 06:21:30.244187 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.234391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:42829 (local address 127.26.252.126:37339)
0807 06:21:30.234597 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.234604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.235872 (+ 1268us) server_negotiation.cc:407] Connection header received
0807 06:21:30.237314 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.237317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.237380 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.237475 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:30.238456 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.239575 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.241444 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.241884 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.241981 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.243589 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:30.243593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:30.243595 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:30.243612 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:30.243639 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:30.243650 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:30.243696 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.243943 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.244012 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:21:30.245738 20235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.234826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:37339 (local address 127.26.252.67:42829)
0807 06:21:30.235677 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.235757 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.237096 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.237642 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.237649 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.237731 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:30.238254 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.238267 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.239767 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.239774 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.241319 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.241333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.242245 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.242251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.242523 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.243268 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:30.243270 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:30.243324 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:30.243402 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:30.243768 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:30.243780 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:30.243788 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.244485 (+ 697us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.244781 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":118,"threads_started":1}
I20260807 06:21:30.246845 20233 heartbeater.cc:347] Connected to a master server at 127.26.252.126:37339
I20260807 06:21:30.247138 20233 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:30.247819 20233 heartbeater.cc:511] Master 127.26.252.126:37339 requested a full tablet report, sending...
I20260807 06:21:30.249027 19623 ts_manager.cc:194] Registered new tserver with Master: 91877d1852a34cb1ba76888969204219 (127.26.252.67:40043)
I20260807 06:21:30.249919 19623 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.67:42829
I20260807 06:21:30.257340 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:30.264050 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.259800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49684 (local address 127.26.252.126:37339)
0807 06:21:30.259952 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.259956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.260369 (+ 413us) server_negotiation.cc:407] Connection header received
0807 06:21:30.260528 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.260531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.260582 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.260672 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:30.260983 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.261497 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.262359 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.262652 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.262765 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.263611 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:30.263614 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:30.263617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:30.263630 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:30.263653 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:30.263668 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:30.263749 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.263844 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.263898 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:21:30.267333 19623 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:30.271441 19623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:30.287643 20255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.281813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38745 (local address 127.0.0.1:39420)
0807 06:21:30.282677 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.282727 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.282860 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.283617 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.283623 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.283657 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:30.283818 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.283827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.285126 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.285131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.286047 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.286056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.287058 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.287062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.287181 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.287222 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.287350 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.287480 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":88,"threads_started":1}
I20260807 06:21:30.287652 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.282231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39420 (local address 127.26.252.65:38745)
0807 06:21:30.282878 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.282892 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.282920 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:21:30.283009 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.283017 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.283232 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.283613 (+ 381us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:30.283964 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.285005 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.286172 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.286920 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.287044 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.287250 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.287381 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.287480 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":130,"threads_started":1}
I20260807 06:21:30.288901 20259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.281980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40043 (local address 127.0.0.1:38296)
0807 06:21:30.283119 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.283133 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.283229 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.284622 (+ 1393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.284625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.284639 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:30.284713 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.284718 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.286024 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.286027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.287139 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.287151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.288452 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.288456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.288547 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.288574 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.288671 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.288754 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":88,"threads_started":1}
I20260807 06:21:30.289099 20253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.282894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:36365 (local address 127.0.0.1:33338)
0807 06:21:30.283256 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.283351 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.283442 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.284383 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.284386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.284406 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:30.284501 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.284508 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.286584 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.286587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.287678 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.287688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.288736 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.288739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.288819 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.288841 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.288887 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.288962 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":102,"threads_started":1}
I20260807 06:21:30.289451 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.282128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38296 (local address 127.26.252.67:40043)
0807 06:21:30.283923 (+ 1795us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.283935 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.283958 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:21:30.284038 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.284042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.284223 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.284383 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:30.284831 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.285895 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.287280 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.288091 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.288204 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.288379 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.289189 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.289298 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1678,"thread_start_us":174,"threads_started":1}
I20260807 06:21:30.291086 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.283617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.26.252.66:36365)
0807 06:21:30.283982 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.283994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.284011 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:21:30.284075 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.284079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.284244 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.284383 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:30.284603 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.286471 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.287820 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.288606 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.290632 (+ 2026us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.290781 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.290820 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.290913 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":158,"threads_started":1}
I20260807 06:21:30.291601 19786 tablet_service.cc:1467] Processing CreateTablet for tablet 579cf620d4544b558e31857dfb3a77bc (DEFAULT_TABLE table=test-table [id=6e11ba9b42e2401cb2541c3a537ea806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:30.292224 20143 tablet_service.cc:1467] Processing CreateTablet for tablet 579cf620d4544b558e31857dfb3a77bc (DEFAULT_TABLE table=test-table [id=6e11ba9b42e2401cb2541c3a537ea806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:30.292832 19786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579cf620d4544b558e31857dfb3a77bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:30.293279 20143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579cf620d4544b558e31857dfb3a77bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:30.293783 19965 tablet_service.cc:1467] Processing CreateTablet for tablet 579cf620d4544b558e31857dfb3a77bc (DEFAULT_TABLE table=test-table [id=6e11ba9b42e2401cb2541c3a537ea806]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:30.294723 19965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 579cf620d4544b558e31857dfb3a77bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:30.300433 20261 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Bootstrap starting.
I20260807 06:21:30.301671 20264 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Bootstrap starting.
I20260807 06:21:30.301669 20262 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Bootstrap starting.
I20260807 06:21:30.302682 20261 tablet_bootstrap.cc:654] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:30.303673 20261 log.cc:824] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:30.303853 20264 tablet_bootstrap.cc:654] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:30.303872 20262 tablet_bootstrap.cc:654] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:30.304668 20262 log.cc:824] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:30.304672 20264 log.cc:824] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:30.305830 20261 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: No bootstrap required, opened a new log
I20260807 06:21:30.306025 20261 ts_tablet_manager.cc:1397] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:21:30.306689 20262 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: No bootstrap required, opened a new log
I20260807 06:21:30.306777 20264 tablet_bootstrap.cc:492] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: No bootstrap required, opened a new log
I20260807 06:21:30.306895 20262 ts_tablet_manager.cc:1397] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 06:21:30.306960 20264 ts_tablet_manager.cc:1397] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.004s
I20260807 06:21:30.310497 20262 raft_consensus.cc:348] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.310755 20262 raft_consensus.cc:374] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:30.310810 20262 raft_consensus.cc:729] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e62cf1e0ef24580838cb31eb16f6656, State: Initialized, Role: FOLLOWER
I20260807 06:21:30.311249 20262 consensus_queue.cc:260] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.311180 20264 raft_consensus.cc:348] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.311444 20264 raft_consensus.cc:374] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:30.311496 20264 raft_consensus.cc:729] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91877d1852a34cb1ba76888969204219, State: Initialized, Role: FOLLOWER
I20260807 06:21:30.311676 20261 raft_consensus.cc:348] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.311916 20261 raft_consensus.cc:374] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:30.311959 20261 raft_consensus.cc:729] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c1f6666f9c34b6faa0ea6e8f4da9e09, State: Initialized, Role: FOLLOWER
I20260807 06:21:30.311884 20264 consensus_queue.cc:260] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.311983 19873 heartbeater.cc:503] Master 127.26.252.126:37339 was elected leader, sending a full tablet report...
I20260807 06:21:30.312253 20262 ts_tablet_manager.cc:1428] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260807 06:21:30.312379 20261 consensus_queue.cc:260] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.313026 20050 heartbeater.cc:503] Master 127.26.252.126:37339 was elected leader, sending a full tablet report...
I20260807 06:21:30.313097 20264 ts_tablet_manager.cc:1428] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260807 06:21:30.313230 20261 ts_tablet_manager.cc:1428] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260807 06:21:30.313429 20233 heartbeater.cc:503] Master 127.26.252.126:37339 was elected leader, sending a full tablet report...
W20260807 06:21:30.345548 19874 tablet.cc:2369] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:30.365626 20278 raft_consensus.cc:482] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:30.365872 20278 raft_consensus.cc:504] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.367170 20278 leader_election.cc:288] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e62cf1e0ef24580838cb31eb16f6656 (127.26.252.65:38745), 91877d1852a34cb1ba76888969204219 (127.26.252.67:40043)
I20260807 06:21:30.370836 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.367395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38745 (local address 127.26.252.66:32953)
0807 06:21:30.367572 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.367591 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.367688 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.367982 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.367985 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.368004 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:30.368138 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.368144 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.368892 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.368896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.369690 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.369700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.370346 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.370350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.370504 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.370525 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.370618 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.370695 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 06:21:30.370836 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.367526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:32953 (local address 127.26.252.65:38745)
0807 06:21:30.367658 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.367664 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.367682 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:21:30.367831 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.367834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.367878 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.367969 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:30.368266 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.368775 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.369827 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.370219 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.370353 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.370405 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.370637 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.370716 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:21:30.371420 20257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.367628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:60321 (local address 127.26.252.67:40043)
0807 06:21:30.367755 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.367760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.368007 (+ 247us) server_negotiation.cc:407] Connection header received
0807 06:21:30.368188 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.368191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.368253 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.368333 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:30.368619 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.369102 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.370130 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.370609 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.370745 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.370800 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.371223 (+ 423us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.371311 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:21:30.371424 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.367447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:40043 (local address 127.26.252.66:60321)
0807 06:21:30.367902 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.367913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:30.368056 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:30.368357 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:30.368360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:30.368376 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:30.368505 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.368511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.369215 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.369221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.369996 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:30.370005 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.370746 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.370749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:30.370848 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.370874 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:21:30.371199 (+ 325us) client_negotiation.cc:240] Negotiation successful
0807 06:21:30.371274 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":1,"spinlock_wait_cycles":2688,"thread_start_us":157,"threads_started":1}
I20260807 06:21:30.371656 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579cf620d4544b558e31857dfb3a77bc" candidate_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e62cf1e0ef24580838cb31eb16f6656" is_pre_election: true
I20260807 06:21:30.372020 19808 raft_consensus.cc:2454] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1f6666f9c34b6faa0ea6e8f4da9e09 in term 0.
I20260807 06:21:30.372159 20173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579cf620d4544b558e31857dfb3a77bc" candidate_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91877d1852a34cb1ba76888969204219" is_pre_election: true
I20260807 06:21:30.372490 20173 raft_consensus.cc:2454] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c1f6666f9c34b6faa0ea6e8f4da9e09 in term 0.
I20260807 06:21:30.372567 19898 leader_election.cc:302] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e62cf1e0ef24580838cb31eb16f6656, 2c1f6666f9c34b6faa0ea6e8f4da9e09; no voters:
I20260807 06:21:30.372829 20278 raft_consensus.cc:2781] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:30.372925 20278 raft_consensus.cc:482] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:30.372980 20278 raft_consensus.cc:3037] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:30.374073 20278 raft_consensus.cc:504] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.374460 20278 leader_election.cc:288] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [CANDIDATE]: Term 1 election: Requested vote from peers 0e62cf1e0ef24580838cb31eb16f6656 (127.26.252.65:38745), 91877d1852a34cb1ba76888969204219 (127.26.252.67:40043)
I20260807 06:21:30.374840 19808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579cf620d4544b558e31857dfb3a77bc" candidate_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e62cf1e0ef24580838cb31eb16f6656"
I20260807 06:21:30.374986 20173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "579cf620d4544b558e31857dfb3a77bc" candidate_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91877d1852a34cb1ba76888969204219"
I20260807 06:21:30.375023 19808 raft_consensus.cc:3037] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:30.375166 20173 raft_consensus.cc:3037] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:30.376264 20173 raft_consensus.cc:2454] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1f6666f9c34b6faa0ea6e8f4da9e09 in term 1.
I20260807 06:21:30.376286 19808 raft_consensus.cc:2454] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c1f6666f9c34b6faa0ea6e8f4da9e09 in term 1.
I20260807 06:21:30.376621 19896 leader_election.cc:302] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c1f6666f9c34b6faa0ea6e8f4da9e09, 91877d1852a34cb1ba76888969204219; no voters:
I20260807 06:21:30.376822 20278 raft_consensus.cc:2781] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:30.377074 20278 raft_consensus.cc:686] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 1 LEADER]: Becoming Leader. State: Replica: 2c1f6666f9c34b6faa0ea6e8f4da9e09, State: Running, Role: LEADER
I20260807 06:21:30.377449 20278 consensus_queue.cc:237] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } }
I20260807 06:21:30.380856 19621 catalog_manager.cc:5495] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c1f6666f9c34b6faa0ea6e8f4da9e09 (127.26.252.66). New cstate: current_term: 1 leader_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c1f6666f9c34b6faa0ea6e8f4da9e09" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36365 } health_report { overall_health: HEALTHY } } }
I20260807 06:21:30.415877 20260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.412129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33350 (local address 127.26.252.66:36365)
0807 06:21:30.412291 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:30.412295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:30.412310 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:21:30.412507 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:30.412510 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:30.412572 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:30.412686 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:30.412954 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.413472 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.414345 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:30.414590 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:30.414703 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:30.415024 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:30.415444 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:30.415580 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:30.415647 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 06:21:30.415703 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:21:30.421913 20173 raft_consensus.cc:1261] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 1 FOLLOWER]: Refusing update from remote peer 2c1f6666f9c34b6faa0ea6e8f4da9e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:30.421911 19808 raft_consensus.cc:1261] T 579cf620d4544b558e31857dfb3a77bc P 0e62cf1e0ef24580838cb31eb16f6656 [term 1 FOLLOWER]: Refusing update from remote peer 2c1f6666f9c34b6faa0ea6e8f4da9e09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:30.422675 20278 consensus_queue.cc:1035] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91877d1852a34cb1ba76888969204219" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 40043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:30.422897 20280 consensus_queue.cc:1035] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e62cf1e0ef24580838cb31eb16f6656" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:30.429904 20288 mvcc.cc:205] Tried to move back new op lower bound from 7315798795960287232 to 7315798795788877824. Current Snapshot: MvccSnapshot[applied={T|T < 7315798795960287232}]
I20260807 06:21:30.438863 19622 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:30.439051 19622 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:30.441663 19622 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67a017c6ff5c480196a2f57eb49a479d: Sending DeleteTablet for 3 replicas of tablet 579cf620d4544b558e31857dfb3a77bc
I20260807 06:21:30.442494 20143 tablet_service.cc:1514] Processing DeleteTablet for tablet 579cf620d4544b558e31857dfb3a77bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:30 UTC) from {username='slave'} at 127.0.0.1:38296
I20260807 06:21:30.442471 19786 tablet_service.cc:1514] Processing DeleteTablet for tablet 579cf620d4544b558e31857dfb3a77bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:30 UTC) from {username='slave'} at 127.0.0.1:39420
I20260807 06:21:30.442544 19965 tablet_service.cc:1514] Processing DeleteTablet for tablet 579cf620d4544b558e31857dfb3a77bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:30 UTC) from {username='slave'} at 127.0.0.1:33338
I20260807 06:21:30.443188 20302 tablet_replica.cc:330] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: stopping tablet replica
I20260807 06:21:30.443522 20302 raft_consensus.cc:2229] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:30.443799 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 19702
I20260807 06:21:30.449532 20302 raft_consensus.cc:2258] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:30.450079 20300 tablet_replica.cc:330] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: stopping tablet replica
I20260807 06:21:30.450461 20300 raft_consensus.cc:2229] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:30.451128 20300 raft_consensus.cc:2258] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:30.451752 20302 ts_tablet_manager.cc:1905] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:30.453672 20300 ts_tablet_manager.cc:1905] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:30.455962 20300 ts_tablet_manager.cc:1918] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:30.456043 20300 log.cc:1196] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/579cf620d4544b558e31857dfb3a77bc
I20260807 06:21:30.456350 20300 ts_tablet_manager.cc:1939] T 579cf620d4544b558e31857dfb3a77bc P 91877d1852a34cb1ba76888969204219: Deleting consensus metadata
I20260807 06:21:30.457469 19602 catalog_manager.cc:4841] TS 91877d1852a34cb1ba76888969204219 (127.26.252.67:40043): tablet 579cf620d4544b558e31857dfb3a77bc (table test-table [id=6e11ba9b42e2401cb2541c3a537ea806]) successfully deleted
I20260807 06:21:30.460511 20302 ts_tablet_manager.cc:1918] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:30.460633 20302 log.cc:1196] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/579cf620d4544b558e31857dfb3a77bc
I20260807 06:21:30.460916 20302 ts_tablet_manager.cc:1939] T 579cf620d4544b558e31857dfb3a77bc P 2c1f6666f9c34b6faa0ea6e8f4da9e09: Deleting consensus metadata
I20260807 06:21:30.461934 19600 catalog_manager.cc:4841] TS 2c1f6666f9c34b6faa0ea6e8f4da9e09 (127.26.252.66:36365): tablet 579cf620d4544b558e31857dfb3a77bc (table test-table [id=6e11ba9b42e2401cb2541c3a537ea806]) successfully deleted
W20260807 06:21:30.462996 19603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:38745 (error 108)
I20260807 06:21:30.463912 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 19876
I20260807 06:21:30.464080 20253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:30.463750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38745 (local address 127.0.0.1:39432)
0807 06:21:30.463918 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:30.463994 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 06:21:30.477880 19603 catalog_manager.cc:4584] TS 0e62cf1e0ef24580838cb31eb16f6656 (127.26.252.65:38745): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 579cf620d4544b558e31857dfb3a77bc: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38745: connect: Connection refused (error 111)
I20260807 06:21:30.483872 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 20054
I20260807 06:21:30.503060 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 19577
2026-08-07T06:21:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1156 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:30 dist-test-slave-68xk krb5kdc[20307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:30 dist-test-slave-68xk krb5kdc[20307](info): set up 2 sockets
Aug 07 06:21:30 dist-test-slave-68xk krb5kdc[20307](info): commencing operation
krb5kdc: starting...
W20260807 06:21:31.811565 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:31 dist-test-slave-68xk krb5kdc[20307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:21:31.943732 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40561
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:40561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:32.060024 20325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:32.060286 20325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:32.060328 20325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:32.064293 20325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:32.064350 20325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:32.064369 20325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:32.064385 20325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:32.064424 20325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:32.069595 20325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:40561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:32.070679 20325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:32.071672 20325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:32.080569 20332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.080587 20335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.080744 20325 server_base.cc:1034] running on GCE node
W20260807 06:21:32.080565 20331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.081501 20325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:32.082741 20325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:32.083940 20325 hybrid_clock.cc:648] HybridClock initialized: now 1786083692083922 us; error 33 us; skew 500 ppm
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:32.090900 20325 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:21:32.091956 20325 webserver.cc:460] Webserver started at http://127.26.252.126:39199/ using document root <none> and password file <none>
I20260807 06:21:32.092602 20325 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:32.092715 20325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:32.092985 20325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:32.095320 20325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "95bd2a876b3d4591948ca53064f509f2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "7cf53bd8edc2e39a89b44ba17332d6d3"
server_key_iv: "4987a18d18ea1bbd7330b5fa89f457ef"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.095952 20325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "95bd2a876b3d4591948ca53064f509f2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "7cf53bd8edc2e39a89b44ba17332d6d3"
server_key_iv: "4987a18d18ea1bbd7330b5fa89f457ef"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.100149 20325 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:32.102774 20344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.104027 20325 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:21:32.104219 20325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "95bd2a876b3d4591948ca53064f509f2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "7cf53bd8edc2e39a89b44ba17332d6d3"
server_key_iv: "4987a18d18ea1bbd7330b5fa89f457ef"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.104348 20325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:32.124270 20325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:32.127398 20325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:32.127600 20325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:32.134438 20325 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:40561
I20260807 06:21:32.134519 20415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:40561 every 8 connection(s)
I20260807 06:21:32.135408 20325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:32.138134 20416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:32.141001 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 20325
I20260807 06:21:32.141197 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:32.141489 27633 external_mini_cluster.cc:1428] Setting key 56df11f2c7e8c9b0a39e618b5918fcf9
I20260807 06:21:32.144207 20416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: Bootstrap starting.
I20260807 06:21:32.146780 20416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:32.147567 20416 log.cc:824] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:32.149731 20416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: No bootstrap required, opened a new log
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:32.153004 20416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } }
I20260807 06:21:32.153219 20416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:32.153280 20416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95bd2a876b3d4591948ca53064f509f2, State: Initialized, Role: FOLLOWER
I20260807 06:21:32.153743 20416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } }
I20260807 06:21:32.153864 20416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:32.153944 20416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:32.154072 20416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:32.155002 20416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } }
I20260807 06:21:32.155344 20416 leader_election.cc:302] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95bd2a876b3d4591948ca53064f509f2; no voters:
I20260807 06:21:32.155686 20416 leader_election.cc:288] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:32.155756 20421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:32.155958 20421 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [term 1 LEADER]: Becoming Leader. State: Replica: 95bd2a876b3d4591948ca53064f509f2, State: Running, Role: LEADER
I20260807 06:21:32.156260 20421 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } }
I20260807 06:21:32.156978 20416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:32.158094 20426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95bd2a876b3d4591948ca53064f509f2. Latest consensus state: current_term: 1 leader_uuid: "95bd2a876b3d4591948ca53064f509f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } } }
I20260807 06:21:32.158074 20422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95bd2a876b3d4591948ca53064f509f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95bd2a876b3d4591948ca53064f509f2" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40561 } } }
I20260807 06:21:32.158242 20426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:32.158242 20422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:32.158659 20428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:32.158850 20419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.143176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46942 (local address 127.26.252.126:40561)
0807 06:21:32.143679 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.143696 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.143735 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:21:32.144475 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.144495 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.144855 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.145171 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:32.146109 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.147398 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.148443 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.148960 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.149097 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.151993 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:32.151999 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:32.152011 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:32.152038 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:32.154609 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.155072 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.155080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.155087 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.155222 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.155518 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.155522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.155524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.156081 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:32.156867 (+ 786us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.156986 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.157309 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":138,"threads_started":1}
I20260807 06:21:32.161993 20428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:32.168310 20428 catalog_manager.cc:1347] Generated new cluster ID: 5bfbc7d6439a4b679b64e20d43690f71
I20260807 06:21:32.168385 20428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:32.191102 20428 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:32.192430 20428 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:32.200488 20428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: Generated new TSK 0
I20260807 06:21:32.201184 20428 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:21:32.233552 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:32.346290 20453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:32.346640 20453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:32.346735 20453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:32.350808 20453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:32.350891 20453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:32.350983 20453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:32.356297 20453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:32.357430 20453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:32.358618 20453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:32.368513 20464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.368518 20462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.368643 20461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.368795 20453 server_base.cc:1034] running on GCE node
I20260807 06:21:32.369277 20453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:32.370038 20453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:32.371270 20453 hybrid_clock.cc:648] HybridClock initialized: now 1786083692371237 us; error 54 us; skew 500 ppm
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:32.374323 20453 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:21:32.375269 20453 webserver.cc:460] Webserver started at http://127.26.252.65:43297/ using document root <none> and password file <none>
I20260807 06:21:32.375860 20453 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:32.375957 20453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:32.376192 20453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:32.378258 20453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "69076752700a45cebc37b713c477d9e2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "74b6a318d096930daaf34e9a3fba6d3d"
server_key_iv: "eb9b5f97ac888168a76ac3f34660cf65"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.378942 20453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "69076752700a45cebc37b713c477d9e2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "74b6a318d096930daaf34e9a3fba6d3d"
server_key_iv: "eb9b5f97ac888168a76ac3f34660cf65"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.383097 20453 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:21:32.385529 20473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.387012 20453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:32.387154 20453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "69076752700a45cebc37b713c477d9e2"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "74b6a318d096930daaf34e9a3fba6d3d"
server_key_iv: "eb9b5f97ac888168a76ac3f34660cf65"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.387270 20453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:32.404775 20453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:32.407872 20453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:32.408093 20453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:32.408780 20453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:32.409672 20453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:32.409736 20453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.409780 20453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:32.409835 20453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.419369 20453 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:46261
I20260807 06:21:32.419407 20639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:46261 every 8 connection(s)
I20260807 06:21:32.420315 20453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:32.420532 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 20453
I20260807 06:21:32.420717 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:32.421109 27633 external_mini_cluster.cc:1428] Setting key 5e9c8932fabcb92780d964b015904717
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:21:32.437000 20419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.422517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:33201 (local address 127.26.252.126:40561)
0807 06:21:32.422704 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.422709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.423788 (+ 1079us) server_negotiation.cc:407] Connection header received
0807 06:21:32.425766 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.425769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.425830 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.425925 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:32.427640 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.428218 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.429838 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.430123 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.430247 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.433051 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:32.433055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:32.433058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:32.433087 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:32.434637 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.435296 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.435302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.435304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.435403 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.435810 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.435813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.435815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.436011 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:32.436136 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.436669 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.436809 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:21:32.437855 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.423005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40561 (local address 127.26.252.65:33201)
0807 06:21:32.423589 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.423653 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.425544 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.426133 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.426141 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.426679 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:32.427438 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.427463 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.428408 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.428416 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.429695 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.429707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.430305 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.430309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.430547 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.431189 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:32.431207 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:32.432867 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:32.434814 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.434819 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.434830 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.435106 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.435518 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.435522 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.435524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.435689 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.436135 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:32.436142 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:32.436395 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.436603 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.436944 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":140,"threads_started":1}
I20260807 06:21:32.439240 20640 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40561
I20260807 06:21:32.439498 20640 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:32.439992 20640 heartbeater.cc:511] Master 127.26.252.126:40561 requested a full tablet report, sending...
I20260807 06:21:32.441684 20368 ts_manager.cc:194] Registered new tserver with Master: 69076752700a45cebc37b713c477d9e2 (127.26.252.65:46261)
I20260807 06:21:32.443346 20368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:33201
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:21:32.453348 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:32.566238 20645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:32.566524 20645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:32.566602 20645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:32.570619 20645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:32.570703 20645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:32.570791 20645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:32.575948 20645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:32.576978 20645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:32.578004 20645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:32.588111 20654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.588186 20650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.588172 20651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.588819 20645 server_base.cc:1034] running on GCE node
I20260807 06:21:32.589283 20645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:32.589993 20645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:32.591224 20645 hybrid_clock.cc:648] HybridClock initialized: now 1786083692591163 us; error 72 us; skew 500 ppm
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:32.594162 20645 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:21:32.595095 20645 webserver.cc:460] Webserver started at http://127.26.252.66:45755/ using document root <none> and password file <none>
I20260807 06:21:32.595631 20645 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:32.595691 20645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:32.595860 20645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:32.597909 20645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "c5a8b868f1034a12800455ec601e6119"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "51f9396d86b371aa28c44cc6155535af"
server_key_iv: "1ed2d1392110738d4ba8ea242bef00b5"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.598518 20645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "c5a8b868f1034a12800455ec601e6119"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "51f9396d86b371aa28c44cc6155535af"
server_key_iv: "1ed2d1392110738d4ba8ea242bef00b5"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.602332 20645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:21:32.604890 20664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.606184 20645 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:32.606288 20645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "c5a8b868f1034a12800455ec601e6119"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "51f9396d86b371aa28c44cc6155535af"
server_key_iv: "1ed2d1392110738d4ba8ea242bef00b5"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.606360 20645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:32.630905 20645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:32.633885 20645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:32.634043 20645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:32.634610 20645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:32.635696 20645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:32.635764 20645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.635826 20645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:32.635857 20645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.645311 20645 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:45407
I20260807 06:21:32.645332 20820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:45407 every 8 connection(s)
I20260807 06:21:32.646201 20645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:32.650116 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 20645
I20260807 06:21:32.650252 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:32.650632 27633 external_mini_cluster.cc:1428] Setting key 7bd31347ac995b8002ee66ec3f7f1f85
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:32.661826 20419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.648001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:42625 (local address 127.26.252.126:40561)
0807 06:21:32.648175 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.648180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.649028 (+ 848us) server_negotiation.cc:407] Connection header received
0807 06:21:32.650504 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.650509 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.650571 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.650673 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:32.652269 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.653028 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.654318 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.654647 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.654773 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.657769 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:32.657775 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:32.657778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:32.657812 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:32.659403 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.660069 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.660075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.660080 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.660167 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.660642 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.660646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.660647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.660832 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:32.660914 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.661599 (+ 685us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.661706 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
I20260807 06:21:32.663003 20824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.648412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40561 (local address 127.26.252.66:42625)
0807 06:21:32.648870 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.648915 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.650213 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.650875 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.650882 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.651278 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:32.652119 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.652141 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.653206 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.653209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.654132 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.654142 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.654815 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.654819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.654990 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.655612 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:32.655629 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:32.657548 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:32.659523 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.659531 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.659549 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.659935 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.660305 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.660311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.660316 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.660510 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.660969 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:32.660977 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:32.661302 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.661547 (+ 245us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.661944 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":101,"threads_started":1}
I20260807 06:21:32.664204 20821 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40561
I20260807 06:21:32.664415 20821 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:32.664873 20821 heartbeater.cc:511] Master 127.26.252.126:40561 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
I20260807 06:21:32.666007 20368 ts_manager.cc:194] Registered new tserver with Master: c5a8b868f1034a12800455ec601e6119 (127.26.252.66:45407)
I20260807 06:21:32.666882 20368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:42625
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:21:32.681767 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:35023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:32.796590 20828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:32.796883 20828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:32.796958 20828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:32.801052 20828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:32.801138 20828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:32.801234 20828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:32.806610 20828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:35023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:40561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:32.807778 20828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:32.808931 20828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:32.818779 20834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:32.818785 20838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.818938 20828 server_base.cc:1034] running on GCE node
W20260807 06:21:32.818809 20835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:32.819463 20828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:32.820060 20828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:32.821252 20828 hybrid_clock.cc:648] HybridClock initialized: now 1786083692821233 us; error 31 us; skew 500 ppm
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:32.824082 20828 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:21:32.825006 20828 webserver.cc:460] Webserver started at http://127.26.252.67:41667/ using document root <none> and password file <none>
I20260807 06:21:32.825610 20828 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:32.825709 20828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:32.825942 20828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:32.828061 20828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "fc66ab8182e641469b741e5edd08a634"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "1c0613b0ad3b2293a283a1cc8c732698"
server_key_iv: "7dabbc9446b4c50bf92086d550675e3e"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.828713 20828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "fc66ab8182e641469b741e5edd08a634"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "1c0613b0ad3b2293a283a1cc8c732698"
server_key_iv: "7dabbc9446b4c50bf92086d550675e3e"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.832600 20828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 06:21:32.835266 20852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.836545 20828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:21:32.836704 20828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "fc66ab8182e641469b741e5edd08a634"
format_stamp: "Formatted at 2026-08-07 06:21:32 on dist-test-slave-68xk"
server_key: "1c0613b0ad3b2293a283a1cc8c732698"
server_key_iv: "7dabbc9446b4c50bf92086d550675e3e"
server_key_version: "encryptionkey@0"
I20260807 06:21:32.836817 20828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:32.858989 20828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:32.862205 20828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:32.862444 20828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:32.863055 20828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:32.863883 20828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:32.863929 20828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.863997 20828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:32.864040 20828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:32.872843 20828 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:45737
I20260807 06:21:32.872905 21010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:45737 every 8 connection(s)
I20260807 06:21:32.873764 20828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:32.879235 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 20828
I20260807 06:21:32.879407 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:32.879724 27633 external_mini_cluster.cc:1428] Setting key 362c399a871108b988a98be6a6590cb2
Aug 07 06:21:32 dist-test-slave-68xk krb5kdc[20307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083692, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:32.888929 20419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.875814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:48519 (local address 127.26.252.126:40561)
0807 06:21:32.875970 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.875974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.876870 (+ 896us) server_negotiation.cc:407] Connection header received
0807 06:21:32.878212 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.878215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.878390 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.878550 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:32.879927 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.880601 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.882549 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.882763 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.882845 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.885524 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:32.885527 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:32.885529 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:32.885554 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:32.886928 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.887428 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.887430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.887431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.887505 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.887924 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.887927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.887928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.888098 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:32.888184 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.888698 (+ 514us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.888805 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:21:32.889763 21014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.876185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:40561 (local address 127.26.252.67:48519)
0807 06:21:32.876700 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.876745 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.877972 (+ 1227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.878759 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.878766 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.879151 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:32.879737 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.879753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.880764 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.880768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.882374 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.882385 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.882904 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.882907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.883059 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.883645 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:32.883663 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:32.885365 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:32.887043 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.887048 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.887061 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.887336 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.887677 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:32.887680 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:32.887682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:32.887824 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:32.888213 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:32.888218 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:32.888439 (+ 221us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.888603 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.888859 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":124,"threads_started":1}
I20260807 06:21:32.890923 21011 heartbeater.cc:347] Connected to a master server at 127.26.252.126:40561
I20260807 06:21:32.891224 21011 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:32.891808 21011 heartbeater.cc:511] Master 127.26.252.126:40561 requested a full tablet report, sending...
I20260807 06:21:32.893002 20368 ts_manager.cc:194] Registered new tserver with Master: fc66ab8182e641469b741e5edd08a634 (127.26.252.67:45737)
I20260807 06:21:32.893867 20368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:48519
I20260807 06:21:32.894248 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:32.904744 20419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.896791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.26.252.126:40561)
0807 06:21:32.896918 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.896922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.897120 (+ 198us) server_negotiation.cc:407] Connection header received
0807 06:21:32.897201 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.897203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.897243 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.897315 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:32.898029 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.898719 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.899616 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.899839 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.899931 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.901517 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:32.901520 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:32.901522 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:32.901558 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:32.903001 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.903485 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.903488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.903489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.903596 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:32.903900 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:32.903903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:32.903904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:32.904133 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:32.904265 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.904533 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.904627 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:21:32.908063 20368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:32.911525 20368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:32.926805 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.920877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46261 (local address 127.0.0.1:57316)
0807 06:21:32.921410 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.921424 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.921520 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.922569 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.922572 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.922606 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:32.922704 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.922710 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.924026 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.924031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.925093 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.925104 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.926223 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.926227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.926344 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.926383 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.926517 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.926635 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":57,"spinlock_wait_cycles":6272,"thread_start_us":118,"threads_started":1}
I20260807 06:21:32.926811 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.921499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57316 (local address 127.26.252.65:46261)
0807 06:21:32.921919 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.921935 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.921957 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:21:32.922046 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.922051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.922247 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.922389 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:32.922841 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.923893 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.925235 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.926094 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.926220 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.926374 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.926555 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.926660 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":100,"threads_started":1}
I20260807 06:21:32.926855 21025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.920644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:45407 (local address 127.0.0.1:58552)
0807 06:21:32.921054 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.921108 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.921237 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.922075 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.922081 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.922104 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:32.922246 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.922253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.923755 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.923759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.925125 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.925180 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.926486 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.926492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.926588 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.926609 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.926689 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.926746 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":122,"thread_start_us":107,"threads_started":1}
I20260807 06:21:32.927220 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.920797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58552 (local address 127.26.252.66:45407)
0807 06:21:32.921215 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.921227 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.921255 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:21:32.921456 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.921463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.921717 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.921879 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:32.922390 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.923607 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.925319 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.926186 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.926290 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.926444 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.926948 (+ 504us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.927056 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":111,"threads_started":1}
I20260807 06:21:32.927901 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.921435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:45737 (local address 127.0.0.1:54870)
0807 06:21:32.922484 (+ 1049us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:32.922500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:32.922603 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:32.923242 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:32.923245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:32.923262 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:32.923361 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.923368 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.924730 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.924734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.925886 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:32.925897 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.927582 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.927585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:32.927648 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.927670 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:21:32.927723 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 06:21:32.927769 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"mutex_wait_us":5,"spinlock_wait_cycles":2816,"thread_start_us":96,"threads_started":1}
I20260807 06:21:32.928124 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:32.921889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54870 (local address 127.26.252.67:45737)
0807 06:21:32.922216 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:32.922228 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:32.922726 (+ 498us) server_negotiation.cc:407] Connection header received
0807 06:21:32.922809 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:32.922816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:32.923062 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:32.923226 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:32.923485 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.924566 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.926025 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:32.927244 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:32.927577 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:32.927720 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:32.927782 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 06:21:32.927871 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":139,"threads_started":1}
I20260807 06:21:32.930357 20736 tablet_service.cc:1467] Processing CreateTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 (DEFAULT_TABLE table=test-table [id=1e4596315ae44d5ca00d65b377282620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:32.930271 20542 tablet_service.cc:1467] Processing CreateTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 (DEFAULT_TABLE table=test-table [id=1e4596315ae44d5ca00d65b377282620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:32.930725 20919 tablet_service.cc:1467] Processing CreateTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 (DEFAULT_TABLE table=test-table [id=1e4596315ae44d5ca00d65b377282620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:32.931429 20736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7464c45d87814f52aaffe2847e0c00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:32.931423 20542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7464c45d87814f52aaffe2847e0c00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:32.931610 20919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7464c45d87814f52aaffe2847e0c00c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:32.938127 21032 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Bootstrap starting.
I20260807 06:21:32.939623 21033 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Bootstrap starting.
I20260807 06:21:32.940475 21032 tablet_bootstrap.cc:654] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:32.941624 21033 tablet_bootstrap.cc:654] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:32.941596 21032 log.cc:824] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:32.942348 21033 log.cc:824] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:32.942363 21036 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Bootstrap starting.
I20260807 06:21:32.943821 21032 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: No bootstrap required, opened a new log
I20260807 06:21:32.944024 21032 ts_tablet_manager.cc:1397] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:21:32.944295 21033 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: No bootstrap required, opened a new log
I20260807 06:21:32.944478 21033 ts_tablet_manager.cc:1397] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 06:21:32.944705 21036 tablet_bootstrap.cc:654] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:32.945712 21036 log.cc:824] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:32.947404 21036 tablet_bootstrap.cc:492] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: No bootstrap required, opened a new log
I20260807 06:21:32.947615 21036 ts_tablet_manager.cc:1397] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:21:32.948307 21032 raft_consensus.cc:348] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.948587 21032 raft_consensus.cc:374] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:32.948648 21032 raft_consensus.cc:729] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5a8b868f1034a12800455ec601e6119, State: Initialized, Role: FOLLOWER
I20260807 06:21:32.948855 21033 raft_consensus.cc:348] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.949103 21033 raft_consensus.cc:374] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:32.949158 21033 raft_consensus.cc:729] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69076752700a45cebc37b713c477d9e2, State: Initialized, Role: FOLLOWER
I20260807 06:21:32.949101 21032 consensus_queue.cc:260] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.949589 21033 consensus_queue.cc:260] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.950139 21032 ts_tablet_manager.cc:1428] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:21:32.950498 21033 ts_tablet_manager.cc:1428] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Time spent starting tablet: real 0.006s user 0.006s sys 0.002s
I20260807 06:21:32.950855 20640 heartbeater.cc:503] Master 127.26.252.126:40561 was elected leader, sending a full tablet report...
I20260807 06:21:32.950941 20821 heartbeater.cc:503] Master 127.26.252.126:40561 was elected leader, sending a full tablet report...
I20260807 06:21:32.951319 21036 raft_consensus.cc:348] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.951557 21036 raft_consensus.cc:374] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:32.951646 21036 raft_consensus.cc:729] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc66ab8182e641469b741e5edd08a634, State: Initialized, Role: FOLLOWER
I20260807 06:21:32.952059 21036 consensus_queue.cc:260] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:32.952731 21011 heartbeater.cc:503] Master 127.26.252.126:40561 was elected leader, sending a full tablet report...
I20260807 06:21:32.952989 21036 ts_tablet_manager.cc:1428] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260807 06:21:33.125015 21013 tablet.cc:2369] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:33.147389 20823 tablet.cc:2369] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:33.172128 20641 tablet.cc:2369] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:33.210299 21044 raft_consensus.cc:482] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:33.210598 21044 raft_consensus.cc:504] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:33.212724 21044 leader_election.cc:288] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5a8b868f1034a12800455ec601e6119 (127.26.252.66:45407), 69076752700a45cebc37b713c477d9e2 (127.26.252.65:46261)
I20260807 06:21:33.217438 21014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.212351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46261 (local address 127.26.252.67:48367)
0807 06:21:33.212488 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:33.212508 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:33.212609 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:33.213058 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:33.213060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:33.213071 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:33.213206 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.213215 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.214278 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.214280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.215841 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.215853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.216804 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.216808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.217014 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.217088 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 06:21:33.217212 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 06:21:33.217267 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":218}
I20260807 06:21:33.217468 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.212572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:48367 (local address 127.26.252.65:46261)
0807 06:21:33.212737 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:33.212744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:33.212760 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:21:33.212816 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:33.212820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:33.212879 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:33.212960 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:33.213347 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.214152 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.215998 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.216639 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.216773 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.216827 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:33.217257 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 06:21:33.217343 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 06:21:33.217468 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.212487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:51917 (local address 127.26.252.66:45407)
0807 06:21:33.212628 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:33.212635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:33.212905 (+ 270us) server_negotiation.cc:407] Connection header received
0807 06:21:33.213079 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:33.213091 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:33.213135 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:33.213198 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:33.213519 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.214241 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.215998 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.216639 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.216773 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.216827 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:33.217257 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 06:21:33.217343 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:21:33.217446 21045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.212358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:45407 (local address 127.26.252.67:51917)
0807 06:21:33.212797 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:33.212809 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:33.212943 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:33.213243 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:33.213248 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:33.213271 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:33.213396 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.213401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.214349 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.214351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.215841 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.215853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.216804 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.216808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.217034 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.217092 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 06:21:33.217183 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:21:33.217265 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":293,"thread_start_us":137,"threads_started":1}
I20260807 06:21:33.218156 20571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7464c45d87814f52aaffe2847e0c00c4" candidate_uuid: "fc66ab8182e641469b741e5edd08a634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69076752700a45cebc37b713c477d9e2" is_pre_election: true
I20260807 06:21:33.218572 20571 raft_consensus.cc:2454] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66ab8182e641469b741e5edd08a634 in term 0.
I20260807 06:21:33.218688 20761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7464c45d87814f52aaffe2847e0c00c4" candidate_uuid: "fc66ab8182e641469b741e5edd08a634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5a8b868f1034a12800455ec601e6119" is_pre_election: true
I20260807 06:21:33.218987 20761 raft_consensus.cc:2454] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc66ab8182e641469b741e5edd08a634 in term 0.
I20260807 06:21:33.219096 20858 leader_election.cc:302] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69076752700a45cebc37b713c477d9e2, fc66ab8182e641469b741e5edd08a634; no voters:
I20260807 06:21:33.219506 21044 raft_consensus.cc:2781] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:33.219596 21044 raft_consensus.cc:482] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:33.219645 21044 raft_consensus.cc:3037] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:33.220685 21044 raft_consensus.cc:504] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:33.221004 21044 leader_election.cc:288] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [CANDIDATE]: Term 1 election: Requested vote from peers c5a8b868f1034a12800455ec601e6119 (127.26.252.66:45407), 69076752700a45cebc37b713c477d9e2 (127.26.252.65:46261)
I20260807 06:21:33.221344 20761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7464c45d87814f52aaffe2847e0c00c4" candidate_uuid: "fc66ab8182e641469b741e5edd08a634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5a8b868f1034a12800455ec601e6119"
I20260807 06:21:33.221344 20571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7464c45d87814f52aaffe2847e0c00c4" candidate_uuid: "fc66ab8182e641469b741e5edd08a634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69076752700a45cebc37b713c477d9e2"
I20260807 06:21:33.221465 20761 raft_consensus.cc:3037] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:33.221467 20571 raft_consensus.cc:3037] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:33.222849 20761 raft_consensus.cc:2454] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66ab8182e641469b741e5edd08a634 in term 1.
I20260807 06:21:33.222849 20571 raft_consensus.cc:2454] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc66ab8182e641469b741e5edd08a634 in term 1.
I20260807 06:21:33.223201 20857 leader_election.cc:302] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5a8b868f1034a12800455ec601e6119, fc66ab8182e641469b741e5edd08a634; no voters:
I20260807 06:21:33.223486 21044 raft_consensus.cc:2781] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:33.223783 21044 raft_consensus.cc:686] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 1 LEADER]: Becoming Leader. State: Replica: fc66ab8182e641469b741e5edd08a634, State: Running, Role: LEADER
I20260807 06:21:33.224180 21044 consensus_queue.cc:237] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } }
I20260807 06:21:33.227497 20368 catalog_manager.cc:5495] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc66ab8182e641469b741e5edd08a634 (127.26.252.67). New cstate: current_term: 1 leader_uuid: "fc66ab8182e641469b741e5edd08a634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc66ab8182e641469b741e5edd08a634" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 } health_report { overall_health: UNKNOWN } } }
I20260807 06:21:33.292330 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.288432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54884 (local address 127.26.252.67:45737)
0807 06:21:33.288584 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:33.288588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:33.288603 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:21:33.288688 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:33.288690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:33.288746 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:33.288835 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:33.289210 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.289730 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.290794 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.291015 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.291107 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.291380 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:33.291894 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:33.292008 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:33.292152 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 06:21:33.292194 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:21:33.298811 20761 raft_consensus.cc:1261] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 1 FOLLOWER]: Refusing update from remote peer fc66ab8182e641469b741e5edd08a634: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:33.298818 20571 raft_consensus.cc:1261] T 7464c45d87814f52aaffe2847e0c00c4 P 69076752700a45cebc37b713c477d9e2 [term 1 FOLLOWER]: Refusing update from remote peer fc66ab8182e641469b741e5edd08a634: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:33.299551 21047 consensus_queue.cc:1035] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69076752700a45cebc37b713c477d9e2" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 46261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:33.299788 21044 consensus_queue.cc:1035] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5a8b868f1034a12800455ec601e6119" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 45407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:33.308951 21056 mvcc.cc:205] Tried to move back new op lower bound from 7315798807744266240 to 7315798807448977408. Current Snapshot: MvccSnapshot[applied={T|T < 7315798807744266240}]
I20260807 06:21:33.316696 20366 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:33.316888 20366 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:33.319633 20366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95bd2a876b3d4591948ca53064f509f2: Sending DeleteTablet for 3 replicas of tablet 7464c45d87814f52aaffe2847e0c00c4
I20260807 06:21:33.320523 20736 tablet_service.cc:1514] Processing DeleteTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:33 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:58552
I20260807 06:21:33.320798 20542 tablet_service.cc:1514] Processing DeleteTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:33 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:57316
I20260807 06:21:33.321228 21069 tablet_replica.cc:330] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: stopping tablet replica
I20260807 06:21:33.321314 20919 tablet_service.cc:1514] Processing DeleteTablet for tablet 7464c45d87814f52aaffe2847e0c00c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:33 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:54870
I20260807 06:21:33.321384 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 20453
I20260807 06:21:33.321738 21069 raft_consensus.cc:2229] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:33.322234 21069 raft_consensus.cc:2258] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:33.325804 21069 ts_tablet_manager.cc:1905] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:33.328787 21069 ts_tablet_manager.cc:1918] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:33.328912 21069 log.cc:1196] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/7464c45d87814f52aaffe2847e0c00c4
I20260807 06:21:33.329219 21069 ts_tablet_manager.cc:1939] T 7464c45d87814f52aaffe2847e0c00c4 P c5a8b868f1034a12800455ec601e6119: Deleting consensus metadata
I20260807 06:21:33.330400 20347 catalog_manager.cc:4841] TS c5a8b868f1034a12800455ec601e6119 (127.26.252.66:45407): tablet 7464c45d87814f52aaffe2847e0c00c4 (table test-table [id=1e4596315ae44d5ca00d65b377282620]) successfully deleted
I20260807 06:21:33.331526 21071 tablet_replica.cc:330] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: stopping tablet replica
I20260807 06:21:33.331841 21071 raft_consensus.cc:2229] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:33.332232 21071 raft_consensus.cc:2258] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:33.333567 21071 ts_tablet_manager.cc:1905] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:21:33.334973 20351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:46261 (error 108)
I20260807 06:21:33.335263 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 20645
I20260807 06:21:33.336396 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.335987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:46261 (local address 127.0.0.1:57328)
0807 06:21:33.336189 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:33.336273 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:46261: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 06:21:33.336376 21071 ts_tablet_manager.cc:1918] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:33.336484 21071 log.cc:1196] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/7464c45d87814f52aaffe2847e0c00c4
W20260807 06:21:33.336731 20351 catalog_manager.cc:4584] TS 69076752700a45cebc37b713c477d9e2 (127.26.252.65:46261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7464c45d87814f52aaffe2847e0c00c4: Network error: Client connection negotiation failed: client connection to 127.26.252.65:46261: connect: Connection refused (error 111)
I20260807 06:21:33.336809 21071 ts_tablet_manager.cc:1939] T 7464c45d87814f52aaffe2847e0c00c4 P fc66ab8182e641469b741e5edd08a634: Deleting consensus metadata
I20260807 06:21:33.338138 20347 catalog_manager.cc:4841] TS fc66ab8182e641469b741e5edd08a634 (127.26.252.67:45737): tablet 7464c45d87814f52aaffe2847e0c00c4 (table test-table [id=1e4596315ae44d5ca00d65b377282620]) successfully deleted
I20260807 06:21:33.347476 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 20828
I20260807 06:21:33.359685 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 20325
2026-08-07T06:21:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2857 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T06:21:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:33Z Disabled control of system clock
I20260807 06:21:33.399276 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39153
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:39153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:33.513518 21079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:33.513779 21079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:33.513815 21079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:33.517899 21079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:33.517959 21079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:33.517975 21079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:33.517992 21079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:33.518008 21079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:33.522805 21079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:39153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:33.523845 21079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:33.525411 21079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:33.533907 21092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:33.533931 21090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:33.533923 21087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:33.534209 21079 server_base.cc:1034] running on GCE node
I20260807 06:21:33.534955 21079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:33.536018 21079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:33.537246 21079 hybrid_clock.cc:648] HybridClock initialized: now 1786083693537211 us; error 48 us; skew 500 ppm
I20260807 06:21:33.539381 21079 webserver.cc:460] Webserver started at http://127.26.252.126:43455/ using document root <none> and password file <none>
I20260807 06:21:33.540015 21079 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:33.540136 21079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:33.540396 21079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:33.542652 21079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "24008b45af3e4399948a39fec2f9452e"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "9d9dbc0cac6ef40ea06851a58a2a0e05"
server_key_iv: "c15104cd143b528ac322a3e4ca59cafd"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.543277 21079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "24008b45af3e4399948a39fec2f9452e"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "9d9dbc0cac6ef40ea06851a58a2a0e05"
server_key_iv: "c15104cd143b528ac322a3e4ca59cafd"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.547299 21079 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:21:33.549770 21099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:33.551270 21079 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:33.551378 21079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "24008b45af3e4399948a39fec2f9452e"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "9d9dbc0cac6ef40ea06851a58a2a0e05"
server_key_iv: "c15104cd143b528ac322a3e4ca59cafd"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.551467 21079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:33.567288 21079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:33.567896 21079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:33.568049 21079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:33.575151 21079 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:39153
I20260807 06:21:33.575223 21173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:39153 every 8 connection(s)
I20260807 06:21:33.576196 21079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:33.579632 21177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:33.585703 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 21079
I20260807 06:21:33.585860 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:33.585840 21177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: Bootstrap starting.
I20260807 06:21:33.586205 27633 external_mini_cluster.cc:1428] Setting key b7b796268644de248a427b8fa000242f
I20260807 06:21:33.588975 21177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:33.589835 21177 log.cc:824] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:33.591989 21177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: No bootstrap required, opened a new log
I20260807 06:21:33.597072 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.587811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34744 (local address 127.26.252.126:39153)
0807 06:21:33.588645 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:33.588663 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:33.588704 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:21:33.589467 (+ 763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:33.589488 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:33.590017 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:33.590484 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:33.590955 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.592025 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.593405 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.593926 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.594063 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.595076 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:33.595081 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:33.595094 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:33.595545 (+ 451us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:33.595602 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:33.595624 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:33.595711 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:33.595943 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 06:21:33.596310 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":166,"threads_started":1}
I20260807 06:21:33.596915 21177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } }
I20260807 06:21:33.597213 21177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:33.597322 21177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24008b45af3e4399948a39fec2f9452e, State: Initialized, Role: FOLLOWER
I20260807 06:21:33.597862 21177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } }
I20260807 06:21:33.598031 21177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:33.598140 21177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:33.598244 21177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:33.599537 21177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } }
I20260807 06:21:33.599911 21177 leader_election.cc:302] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24008b45af3e4399948a39fec2f9452e; no voters:
I20260807 06:21:33.600253 21177 leader_election.cc:288] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:33.600414 21182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:33.600683 21182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [term 1 LEADER]: Becoming Leader. State: Replica: 24008b45af3e4399948a39fec2f9452e, State: Running, Role: LEADER
I20260807 06:21:33.601017 21182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } }
I20260807 06:21:33.601537 21177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:33.603024 21184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24008b45af3e4399948a39fec2f9452e. Latest consensus state: current_term: 1 leader_uuid: "24008b45af3e4399948a39fec2f9452e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } } }
I20260807 06:21:33.603029 21183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24008b45af3e4399948a39fec2f9452e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24008b45af3e4399948a39fec2f9452e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39153 } } }
I20260807 06:21:33.603178 21184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:33.603253 21183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:33.603645 21194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:33.607054 21194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:33.612605 21194 catalog_manager.cc:1347] Generated new cluster ID: 0028c3417e09467882b3ddba53193f73
I20260807 06:21:33.612679 21194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:33.635591 21194 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:33.636622 21194 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:33.645835 21194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: Generated new TSK 0
I20260807 06:21:33.646651 21194 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:33.658476 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--builtin_ntp_servers=127.26.252.84:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:33.778494 21213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:33.778746 21213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:33.778784 21213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:33.782711 21213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:33.782768 21213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:33.782820 21213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:33.787418 21213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:33.788448 21213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:33.789790 21213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:33.799533 21226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:33.799589 21224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:33.799729 21213 server_base.cc:1034] running on GCE node
W20260807 06:21:33.799588 21223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:33.800334 21213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:33.800976 21213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:33.802160 21213 hybrid_clock.cc:648] HybridClock initialized: now 1786083693802142 us; error 31 us; skew 500 ppm
I20260807 06:21:33.804268 21213 webserver.cc:460] Webserver started at http://127.26.252.65:46403/ using document root <none> and password file <none>
I20260807 06:21:33.804864 21213 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:33.804960 21213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:33.805183 21213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:33.807502 21213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "08100f21f6874a64840ace5bcb494126"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "c2694a3eeb2398cc0616ba0a0e215301"
server_key_iv: "dcda412c96d934c875c050c6c987cb2e"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.808086 21213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "08100f21f6874a64840ace5bcb494126"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "c2694a3eeb2398cc0616ba0a0e215301"
server_key_iv: "dcda412c96d934c875c050c6c987cb2e"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.811823 21213 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:21:33.814328 21235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:33.815582 21213 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:33.815726 21213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "08100f21f6874a64840ace5bcb494126"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "c2694a3eeb2398cc0616ba0a0e215301"
server_key_iv: "dcda412c96d934c875c050c6c987cb2e"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.815877 21213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:33.832957 21213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:33.833660 21213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:33.833877 21213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:33.834576 21213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:33.835539 21213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:33.835615 21213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:33.835688 21213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:33.835724 21213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:33.844866 21213 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:38361
I20260807 06:21:33.844897 21397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:38361 every 8 connection(s)
I20260807 06:21:33.845829 21213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:33.846467 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 21213
I20260807 06:21:33.846611 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:33.846930 27633 external_mini_cluster.cc:1428] Setting key e8436014c109b2e62c3c9020240b792b
I20260807 06:21:33.849277 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--builtin_ntp_servers=127.26.252.84:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:33.857352 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.847862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:59377 (local address 127.26.252.126:39153)
0807 06:21:33.847994 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:33.847998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:33.849307 (+ 1309us) server_negotiation.cc:407] Connection header received
0807 06:21:33.850867 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:33.850874 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:33.850947 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:33.851056 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:33.852355 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.852963 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.854927 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.855273 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.855381 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.856823 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:33.856826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:33.856828 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:33.856840 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:33.856860 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:33.856868 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:33.856937 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:33.857147 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 06:21:33.857238 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 06:21:33.858673 21411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:33.848405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39153 (local address 127.26.252.65:59377)
0807 06:21:33.849121 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:33.849175 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:33.850649 (+ 1474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:33.851311 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:33.851322 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:33.851438 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:33.852154 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.852176 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.853114 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.853121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.854765 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:33.854781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:33.855452 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:33.855460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:33.855716 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:33.856453 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:33.856457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:33.856520 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:33.856618 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:33.856970 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:33.856982 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:33.856989 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:21:33.857140 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 06:21:33.857486 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":144,"threads_started":1}
I20260807 06:21:33.860112 21398 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39153
I20260807 06:21:33.860396 21398 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:33.861093 21398 heartbeater.cc:511] Master 127.26.252.126:39153 requested a full tablet report, sending...
I20260807 06:21:33.863001 21122 ts_manager.cc:194] Registered new tserver with Master: 08100f21f6874a64840ace5bcb494126 (127.26.252.65:38361)
I20260807 06:21:33.864563 21122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.65:59377
W20260807 06:21:33.968698 21413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:33.968974 21413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:33.969071 21413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:33.973644 21413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:33.973707 21413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:33.973767 21413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:33.978507 21413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:33.979579 21413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:33.980964 21413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:33.990866 21421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:33.990880 21420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:33.990986 21423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:33.991268 21413 server_base.cc:1034] running on GCE node
I20260807 06:21:33.991709 21413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:33.992419 21413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:33.993606 21413 hybrid_clock.cc:648] HybridClock initialized: now 1786083693993588 us; error 36 us; skew 500 ppm
I20260807 06:21:33.995580 21413 webserver.cc:460] Webserver started at http://127.26.252.66:33997/ using document root <none> and password file <none>
I20260807 06:21:33.996181 21413 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:33.996245 21413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:33.996479 21413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:33.998641 21413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "863e420d3a7f46a5b108029580558adf"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "4f2df22608c580b9e36fd965a96d31cc"
server_key_iv: "7fa49a9755ca3798fb4a6c4cd6fd2163"
server_key_version: "encryptionkey@0"
I20260807 06:21:33.999236 21413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "863e420d3a7f46a5b108029580558adf"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "4f2df22608c580b9e36fd965a96d31cc"
server_key_iv: "7fa49a9755ca3798fb4a6c4cd6fd2163"
server_key_version: "encryptionkey@0"
I20260807 06:21:34.003335 21413 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:21:34.006247 21431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.007670 21413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:21:34.007812 21413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "863e420d3a7f46a5b108029580558adf"
format_stamp: "Formatted at 2026-08-07 06:21:33 on dist-test-slave-68xk"
server_key: "4f2df22608c580b9e36fd965a96d31cc"
server_key_iv: "7fa49a9755ca3798fb4a6c4cd6fd2163"
server_key_version: "encryptionkey@0"
I20260807 06:21:34.007925 21413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:34.028383 21413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:34.029121 21413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:34.029364 21413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:34.030015 21413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:34.031038 21413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:34.031090 21413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.031131 21413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:34.031147 21413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.040764 21413 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:36971
I20260807 06:21:34.040793 21588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:36971 every 8 connection(s)
I20260807 06:21:34.041703 21413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:34.047717 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 21413
I20260807 06:21:34.047861 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:34.048151 27633 external_mini_cluster.cc:1428] Setting key 6507d80c22efaa93c945f34f83471be6
I20260807 06:21:34.050571 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--builtin_ntp_servers=127.26.252.84:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:34.051872 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.043747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:56875 (local address 127.26.252.126:39153)
0807 06:21:34.043897 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.043900 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.044892 (+ 992us) server_negotiation.cc:407] Connection header received
0807 06:21:34.046333 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.046335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.046385 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.046480 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:34.047553 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.048189 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.049653 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.049939 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.050025 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.051401 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:34.051404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:34.051406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:34.051418 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:34.051437 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:34.051445 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:34.051505 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.051710 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.051761 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:21:34.053012 21591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.044045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39153 (local address 127.26.252.66:56875)
0807 06:21:34.044733 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.044776 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.046130 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.046669 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.046676 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.046757 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:34.047321 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.047336 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.048371 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.048375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.049509 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.049523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.050106 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.050110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.050318 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.051082 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:34.051086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:34.051140 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:34.051231 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:34.051534 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:34.051546 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:34.051556 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.051707 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.052007 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":121,"threads_started":1}
I20260807 06:21:34.054193 21589 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39153
I20260807 06:21:34.054483 21589 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:34.055045 21589 heartbeater.cc:511] Master 127.26.252.126:39153 requested a full tablet report, sending...
I20260807 06:21:34.056212 21122 ts_manager.cc:194] Registered new tserver with Master: 863e420d3a7f46a5b108029580558adf (127.26.252.66:36971)
I20260807 06:21:34.056890 21122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.66:56875
W20260807 06:21:34.165019 21594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:34.165306 21594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:34.165345 21594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:34.169368 21594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:34.169425 21594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:34.169477 21594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:34.174192 21594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:34.175304 21594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:34.176704 21594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:34.186290 21606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:34.186297 21608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:34.186316 21603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:34.186434 21594 server_base.cc:1034] running on GCE node
I20260807 06:21:34.187065 21594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:34.187847 21594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:34.189021 21594 hybrid_clock.cc:648] HybridClock initialized: now 1786083694189000 us; error 33 us; skew 500 ppm
I20260807 06:21:34.191138 21594 webserver.cc:460] Webserver started at http://127.26.252.67:45029/ using document root <none> and password file <none>
I20260807 06:21:34.191735 21594 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:34.191802 21594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:34.192044 21594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:34.194135 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "f15000f638f54ef1931d59987a42b85d"
format_stamp: "Formatted at 2026-08-07 06:21:34 on dist-test-slave-68xk"
server_key: "216e6a6d8745ae291cee52a92ea9db86"
server_key_iv: "acd2e0d22d6adac312c07644928ade4e"
server_key_version: "encryptionkey@0"
I20260807 06:21:34.194765 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "f15000f638f54ef1931d59987a42b85d"
format_stamp: "Formatted at 2026-08-07 06:21:34 on dist-test-slave-68xk"
server_key: "216e6a6d8745ae291cee52a92ea9db86"
server_key_iv: "acd2e0d22d6adac312c07644928ade4e"
server_key_version: "encryptionkey@0"
I20260807 06:21:34.198575 21594 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:21:34.201198 21617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.202839 21594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:34.202980 21594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "f15000f638f54ef1931d59987a42b85d"
format_stamp: "Formatted at 2026-08-07 06:21:34 on dist-test-slave-68xk"
server_key: "216e6a6d8745ae291cee52a92ea9db86"
server_key_iv: "acd2e0d22d6adac312c07644928ade4e"
server_key_version: "encryptionkey@0"
I20260807 06:21:34.203105 21594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:34.212668 21594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:34.213331 21594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:34.213531 21594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:34.214118 21594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:34.215142 21594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:34.215217 21594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.215319 21594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:34.215372 21594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:34.224723 21594 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:45721
I20260807 06:21:34.224785 21772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:45721 every 8 connection(s)
I20260807 06:21:34.225692 21594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:34.228475 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 21594
I20260807 06:21:34.228591 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:34.228889 27633 external_mini_cluster.cc:1428] Setting key 0b444047ad6f840336c478830483f1ac
I20260807 06:21:34.235273 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.227596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:35409 (local address 127.26.252.126:39153)
0807 06:21:34.227754 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.227758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.228763 (+ 1005us) server_negotiation.cc:407] Connection header received
0807 06:21:34.230482 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.230485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.230542 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.230628 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:34.231599 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.232141 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.233289 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.233518 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.233645 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.234771 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:34.234774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:34.234777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:34.234797 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:34.234816 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:34.234824 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:34.234903 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.235062 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.235133 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:21:34.236069 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.227964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39153 (local address 127.26.252.67:35409)
0807 06:21:34.228609 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.228649 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.230265 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.230807 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.230813 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.230915 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:34.231460 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.231474 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.232275 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.232278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.233160 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.233170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.233684 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.233688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.233855 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.234509 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:34.234511 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:34.234550 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:34.234618 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:34.234907 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:34.234919 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:34.234925 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.235062 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.235332 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":145,"threads_started":1}
I20260807 06:21:34.237106 21773 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39153
I20260807 06:21:34.237317 21773 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:34.237773 21773 heartbeater.cc:511] Master 127.26.252.126:39153 requested a full tablet report, sending...
I20260807 06:21:34.238819 21122 ts_manager.cc:194] Registered new tserver with Master: f15000f638f54ef1931d59987a42b85d (127.26.252.67:45721)
I20260807 06:21:34.239399 21122 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.67:35409
I20260807 06:21:34.242911 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:34.249375 21180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.244924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.26.252.126:39153)
0807 06:21:34.245096 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.245101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.245385 (+ 284us) server_negotiation.cc:407] Connection header received
0807 06:21:34.245454 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.245456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.245497 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.245572 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:34.245838 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.246384 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.247423 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.247672 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.247793 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.248803 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:34.248814 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:34.248818 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:34.248830 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:34.248848 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:34.248856 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:34.249000 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.249174 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.249216 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:21:34.252614 21122 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:34.255846 21122 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:34.271024 21790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.264769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38361 (local address 127.0.0.1:40246)
0807 06:21:34.265505 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.265557 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.265683 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.266603 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.266608 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.266638 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:34.266771 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.266797 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.268190 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.268193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.269609 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.269621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270486 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.270598 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.270635 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.270739 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.270857 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":112,"thread_start_us":84,"threads_started":1}
I20260807 06:21:34.271034 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.264896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40246 (local address 127.26.252.65:38361)
0807 06:21:34.266017 (+ 1121us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.266038 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.266064 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:21:34.266157 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.266162 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.266377 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.266608 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:34.266924 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.268072 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.269795 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270335 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270494 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.270709 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.270765 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.270857 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":997,"thread_start_us":150,"threads_started":1}
I20260807 06:21:34.271392 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.264823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:45721 (local address 127.0.0.1:50678)
0807 06:21:34.265811 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.265825 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.265928 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.267047 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.267052 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.267075 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:34.267171 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.267177 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.268528 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.268531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.269530 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.269540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270876 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.271055 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.271111 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.271184 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.271250 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":925,"mutex_wait_us":78,"thread_start_us":117,"threads_started":1}
I20260807 06:21:34.271802 21800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.265268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50678 (local address 127.26.252.67:45721)
0807 06:21:34.266508 (+ 1240us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.266519 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.266539 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:21:34.266606 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.266611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.266770 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.266895 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:34.267304 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.268399 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.269666 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270498 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270618 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.270807 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.271492 (+ 685us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.271620 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1117,"thread_start_us":105,"threads_started":1}
I20260807 06:21:34.272879 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.265502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:36971 (local address 127.0.0.1:52336)
0807 06:21:34.266261 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.266275 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.266369 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.266837 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.266843 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.266867 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:34.266968 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.266976 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.268056 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.268062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.269625 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.269632 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270876 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.271059 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.271098 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.272662 (+ 1564us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.272752 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":129,"thread_start_us":96,"threads_started":1}
I20260807 06:21:34.273326 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.265803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52336 (local address 127.26.252.66:36971)
0807 06:21:34.266271 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.266284 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.266379 (+ 95us) server_negotiation.cc:407] Connection header received
0807 06:21:34.266512 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.266519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.266695 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.266851 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:34.267145 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.267935 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.269758 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.270546 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.270638 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.270807 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.273061 (+ 2254us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.273168 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":123,"threads_started":1}
I20260807 06:21:34.274304 21303 tablet_service.cc:1467] Processing CreateTablet for tablet 4b656e6b910c4db784b497c3b735ec3d (DEFAULT_TABLE table=test-table [id=1c5dcbf4e81d44be806ec587554372b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:34.274515 21672 tablet_service.cc:1467] Processing CreateTablet for tablet 4b656e6b910c4db784b497c3b735ec3d (DEFAULT_TABLE table=test-table [id=1c5dcbf4e81d44be806ec587554372b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:34.275449 21303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b656e6b910c4db784b497c3b735ec3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:34.275575 21672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b656e6b910c4db784b497c3b735ec3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:34.276214 21497 tablet_service.cc:1467] Processing CreateTablet for tablet 4b656e6b910c4db784b497c3b735ec3d (DEFAULT_TABLE table=test-table [id=1c5dcbf4e81d44be806ec587554372b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:34.277217 21497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b656e6b910c4db784b497c3b735ec3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:34.281883 21806 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Bootstrap starting.
I20260807 06:21:34.283958 21809 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Bootstrap starting.
I20260807 06:21:34.284305 21806 tablet_bootstrap.cc:654] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:34.284612 21808 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Bootstrap starting.
I20260807 06:21:34.285221 21806 log.cc:824] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:34.286103 21809 tablet_bootstrap.cc:654] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:34.286669 21808 tablet_bootstrap.cc:654] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:34.286963 21809 log.cc:824] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:34.287448 21808 log.cc:824] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:34.287835 21806 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: No bootstrap required, opened a new log
I20260807 06:21:34.288041 21806 ts_tablet_manager.cc:1397] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:21:34.289074 21809 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: No bootstrap required, opened a new log
I20260807 06:21:34.289275 21809 ts_tablet_manager.cc:1397] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:21:34.289419 21808 tablet_bootstrap.cc:492] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: No bootstrap required, opened a new log
I20260807 06:21:34.289624 21808 ts_tablet_manager.cc:1397] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 06:21:34.292446 21806 raft_consensus.cc:348] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.292724 21806 raft_consensus.cc:374] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:34.292958 21806 raft_consensus.cc:729] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08100f21f6874a64840ace5bcb494126, State: Initialized, Role: FOLLOWER
I20260807 06:21:34.292791 21808 raft_consensus.cc:348] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.293073 21808 raft_consensus.cc:374] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:34.293133 21808 raft_consensus.cc:729] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15000f638f54ef1931d59987a42b85d, State: Initialized, Role: FOLLOWER
I20260807 06:21:34.293440 21806 consensus_queue.cc:260] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.293545 21808 consensus_queue.cc:260] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.293617 21809 raft_consensus.cc:348] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.293857 21809 raft_consensus.cc:374] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:34.293915 21809 raft_consensus.cc:729] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 863e420d3a7f46a5b108029580558adf, State: Initialized, Role: FOLLOWER
I20260807 06:21:34.294505 21806 ts_tablet_manager.cc:1428] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260807 06:21:34.294435 21809 consensus_queue.cc:260] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.294508 21808 ts_tablet_manager.cc:1428] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260807 06:21:34.294886 21398 heartbeater.cc:503] Master 127.26.252.126:39153 was elected leader, sending a full tablet report...
I20260807 06:21:34.294886 21773 heartbeater.cc:503] Master 127.26.252.126:39153 was elected leader, sending a full tablet report...
I20260807 06:21:34.295308 21809 ts_tablet_manager.cc:1428] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:21:34.295845 21589 heartbeater.cc:503] Master 127.26.252.126:39153 was elected leader, sending a full tablet report...
W20260807 06:21:34.347244 21407 tablet.cc:2369] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:34.349165 21814 raft_consensus.cc:482] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:34.349357 21814 raft_consensus.cc:504] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.350512 21814 leader_election.cc:288] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08100f21f6874a64840ace5bcb494126 (127.26.252.65:38361), 863e420d3a7f46a5b108029580558adf (127.26.252.66:36971)
I20260807 06:21:34.354060 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.350897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:37047 (local address 127.26.252.65:38361)
0807 06:21:34.351018 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.351022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.351037 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:21:34.351141 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.351144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.351194 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.351287 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:34.351568 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.352067 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353100 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.353496 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353624 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.353677 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.353869 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.353938 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:21:34.354060 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.350771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38361 (local address 127.26.252.67:37047)
0807 06:21:34.350917 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.350936 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.351038 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.351301 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.351304 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.351323 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:34.351454 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.351460 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.352185 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.352190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.352975 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.352984 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.353625 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.353737 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.353765 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.353852 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.353922 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 06:21:34.354478 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.350903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:50537 (local address 127.26.252.66:36971)
0807 06:21:34.351051 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.351059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.351395 (+ 336us) server_negotiation.cc:407] Connection header received
0807 06:21:34.351549 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.351553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.351610 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.351694 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:34.351964 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.352448 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353451 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.353850 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353985 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.354030 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.354268 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.354342 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:21:34.354765 21330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b656e6b910c4db784b497c3b735ec3d" candidate_uuid: "f15000f638f54ef1931d59987a42b85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100f21f6874a64840ace5bcb494126" is_pre_election: true
I20260807 06:21:34.354872 21816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.350771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:36971 (local address 127.26.252.67:50537)
0807 06:21:34.351295 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.351307 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:34.351434 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:34.351707 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:34.351710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:34.351727 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:34.351850 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.351855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.352563 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.352567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.353327 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:34.353335 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.353979 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.353983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:34.354081 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.354109 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:21:34.354668 (+ 559us) client_negotiation.cc:240] Negotiation successful
0807 06:21:34.354745 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":125,"thread_start_us":141,"threads_started":1}
I20260807 06:21:34.355103 21330 raft_consensus.cc:2454] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15000f638f54ef1931d59987a42b85d in term 0.
I20260807 06:21:34.355600 21528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b656e6b910c4db784b497c3b735ec3d" candidate_uuid: "f15000f638f54ef1931d59987a42b85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "863e420d3a7f46a5b108029580558adf" is_pre_election: true
I20260807 06:21:34.355639 21619 leader_election.cc:302] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08100f21f6874a64840ace5bcb494126, f15000f638f54ef1931d59987a42b85d; no voters:
I20260807 06:21:34.355906 21528 raft_consensus.cc:2454] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15000f638f54ef1931d59987a42b85d in term 0.
I20260807 06:21:34.355939 21814 raft_consensus.cc:2781] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:34.356038 21814 raft_consensus.cc:482] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:34.356094 21814 raft_consensus.cc:3037] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:34.357174 21814 raft_consensus.cc:504] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.357535 21814 leader_election.cc:288] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [CANDIDATE]: Term 1 election: Requested vote from peers 08100f21f6874a64840ace5bcb494126 (127.26.252.65:38361), 863e420d3a7f46a5b108029580558adf (127.26.252.66:36971)
I20260807 06:21:34.357847 21330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b656e6b910c4db784b497c3b735ec3d" candidate_uuid: "f15000f638f54ef1931d59987a42b85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08100f21f6874a64840ace5bcb494126"
I20260807 06:21:34.357990 21330 raft_consensus.cc:3037] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:34.357961 21528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b656e6b910c4db784b497c3b735ec3d" candidate_uuid: "f15000f638f54ef1931d59987a42b85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "863e420d3a7f46a5b108029580558adf"
I20260807 06:21:34.358142 21528 raft_consensus.cc:3037] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:34.359238 21528 raft_consensus.cc:2454] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15000f638f54ef1931d59987a42b85d in term 1.
I20260807 06:21:34.359251 21330 raft_consensus.cc:2454] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15000f638f54ef1931d59987a42b85d in term 1.
I20260807 06:21:34.359579 21621 leader_election.cc:302] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 863e420d3a7f46a5b108029580558adf, f15000f638f54ef1931d59987a42b85d; no voters:
I20260807 06:21:34.359823 21814 raft_consensus.cc:2781] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:34.360051 21814 raft_consensus.cc:686] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 1 LEADER]: Becoming Leader. State: Replica: f15000f638f54ef1931d59987a42b85d, State: Running, Role: LEADER
I20260807 06:21:34.360427 21814 consensus_queue.cc:237] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } }
I20260807 06:21:34.363893 21121 catalog_manager.cc:5495] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d reported cstate change: term changed from 0 to 1, leader changed from <none> to f15000f638f54ef1931d59987a42b85d (127.26.252.67). New cstate: current_term: 1 leader_uuid: "f15000f638f54ef1931d59987a42b85d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15000f638f54ef1931d59987a42b85d" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 45721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260807 06:21:34.392884 21800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.389296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50694 (local address 127.26.252.67:45721)
0807 06:21:34.389466 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:34.389470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:34.389484 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:21:34.389553 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:34.389555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:34.389624 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:34.389733 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:34.389959 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.390616 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.391511 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:34.391732 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:34.391821 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:34.392138 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:34.392518 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:34.392631 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:34.392727 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 06:21:34.392759 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 06:21:34.398881 21528 raft_consensus.cc:1261] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 1 FOLLOWER]: Refusing update from remote peer f15000f638f54ef1931d59987a42b85d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:34.398881 21330 raft_consensus.cc:1261] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 1 FOLLOWER]: Refusing update from remote peer f15000f638f54ef1931d59987a42b85d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:34.399739 21814 consensus_queue.cc:1035] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08100f21f6874a64840ace5bcb494126" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:34.400018 21817 consensus_queue.cc:1035] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [LEADER]: Connected to new peer: Peer: permanent_uuid: "863e420d3a7f46a5b108029580558adf" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:34.407688 21823 mvcc.cc:205] Tried to move back new op lower bound from 7315798812249923584 to 7315798812103020544. Current Snapshot: MvccSnapshot[applied={T|T < 7315798812249923584}]
I20260807 06:21:34.408742 21824 mvcc.cc:205] Tried to move back new op lower bound from 7315798812249923584 to 7315798812103020544. Current Snapshot: MvccSnapshot[applied={T|T < 7315798812249923584}]
I20260807 06:21:34.409606 21825 mvcc.cc:205] Tried to move back new op lower bound from 7315798812249923584 to 7315798812103020544. Current Snapshot: MvccSnapshot[applied={T|T < 7315798812249923584}]
I20260807 06:21:34.418141 21122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:34.418329 21122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:34.421207 21122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24008b45af3e4399948a39fec2f9452e: Sending DeleteTablet for 3 replicas of tablet 4b656e6b910c4db784b497c3b735ec3d
I20260807 06:21:34.422075 21672 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b656e6b910c4db784b497c3b735ec3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:34 UTC) from {username='slave'} at 127.0.0.1:50678
I20260807 06:21:34.422060 21303 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b656e6b910c4db784b497c3b735ec3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:34 UTC) from {username='slave'} at 127.0.0.1:40246
I20260807 06:21:34.422097 21497 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b656e6b910c4db784b497c3b735ec3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:34 UTC) from {username='slave'} at 127.0.0.1:52336
I20260807 06:21:34.422636 21838 tablet_replica.cc:330] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126: stopping tablet replica
I20260807 06:21:34.423012 21838 raft_consensus.cc:2229] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:34.423069 21839 tablet_replica.cc:330] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: stopping tablet replica
I20260807 06:21:34.423372 21839 raft_consensus.cc:2229] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:34.423385 21838 raft_consensus.cc:2258] T 4b656e6b910c4db784b497c3b735ec3d P 08100f21f6874a64840ace5bcb494126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:34.423528 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 21213
I20260807 06:21:34.424082 21839 raft_consensus.cc:2258] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:34.422842 21837 tablet_replica.cc:330] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: stopping tablet replica
I20260807 06:21:34.429478 21837 raft_consensus.cc:2229] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:34.429986 21837 raft_consensus.cc:2258] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:34.430512 21839 ts_tablet_manager.cc:1905] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:34.431514 21837 ts_tablet_manager.cc:1905] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:34.433748 21839 ts_tablet_manager.cc:1918] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:34.433871 21839 log.cc:1196] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/4b656e6b910c4db784b497c3b735ec3d
I20260807 06:21:34.434242 21839 ts_tablet_manager.cc:1939] T 4b656e6b910c4db784b497c3b735ec3d P 863e420d3a7f46a5b108029580558adf: Deleting consensus metadata
I20260807 06:21:34.434944 21837 ts_tablet_manager.cc:1918] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:34.435118 21837 log.cc:1196] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/4b656e6b910c4db784b497c3b735ec3d
I20260807 06:21:34.435545 21837 ts_tablet_manager.cc:1939] T 4b656e6b910c4db784b497c3b735ec3d P f15000f638f54ef1931d59987a42b85d: Deleting consensus metadata
I20260807 06:21:34.435773 21102 catalog_manager.cc:4841] TS 863e420d3a7f46a5b108029580558adf (127.26.252.66:36971): tablet 4b656e6b910c4db784b497c3b735ec3d (table test-table [id=1c5dcbf4e81d44be806ec587554372b8]) successfully deleted
W20260807 06:21:34.436259 21101 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:38361 (error 108)
I20260807 06:21:34.437011 21102 catalog_manager.cc:4841] TS f15000f638f54ef1931d59987a42b85d (127.26.252.67:45721): tablet 4b656e6b910c4db784b497c3b735ec3d (table test-table [id=1c5dcbf4e81d44be806ec587554372b8]) successfully deleted
I20260807 06:21:34.437384 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:34.437053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:38361 (local address 127.0.0.1:40258)
0807 06:21:34.437200 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:34.437278 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:21:34.437430 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 21413
W20260807 06:21:34.437578 21101 catalog_manager.cc:4584] TS 08100f21f6874a64840ace5bcb494126 (127.26.252.65:38361): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4b656e6b910c4db784b497c3b735ec3d: Network error: Client connection negotiation failed: client connection to 127.26.252.65:38361: connect: Connection refused (error 111)
I20260807 06:21:34.456092 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 21594
I20260807 06:21:34.465795 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 21079
2026-08-07T06:21:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1104 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:34 dist-test-slave-68xk krb5kdc[21845](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:34 dist-test-slave-68xk krb5kdc[21845](info): set up 2 sockets
Aug 07 06:21:34 dist-test-slave-68xk krb5kdc[21845](info): commencing operation
krb5kdc: starting...
W20260807 06:21:35.690110 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:35 dist-test-slave-68xk krb5kdc[21845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:21:35.821660 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39123
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:39123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:35.936205 21863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:35.936471 21863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:35.936512 21863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:35.940541 21863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:35.940600 21863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:35.940619 21863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:35.940636 21863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:35.940651 21863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:35.945905 21863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:39123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:39123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:35.947041 21863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:35.948117 21863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:35.956836 21870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:35.956835 21873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:35.956943 21863 server_base.cc:1034] running on GCE node
W20260807 06:21:35.957089 21876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:35.957721 21863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:35.958812 21863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:35.960005 21863 hybrid_clock.cc:648] HybridClock initialized: now 1786083695959974 us; error 42 us; skew 500 ppm
Aug 07 06:21:35 dist-test-slave-68xk krb5kdc[21845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083695, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:35.962949 21863 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:21:35.963821 21863 webserver.cc:460] Webserver started at http://127.26.252.126:42931/ using document root <none> and password file <none>
I20260807 06:21:35.964380 21863 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:35.964442 21863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:35.964659 21863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:35.966779 21863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "fe4c56df968749eda6facd4291744c7d"
format_stamp: "Formatted at 2026-08-07 06:21:35 on dist-test-slave-68xk"
server_key: "21ea8c20fdf69c625dbbe0054db37876"
server_key_iv: "f7e297df9fe97cd28da803c225f34551"
server_key_version: "encryptionkey@0"
I20260807 06:21:35.967346 21863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "fe4c56df968749eda6facd4291744c7d"
format_stamp: "Formatted at 2026-08-07 06:21:35 on dist-test-slave-68xk"
server_key: "21ea8c20fdf69c625dbbe0054db37876"
server_key_iv: "f7e297df9fe97cd28da803c225f34551"
server_key_version: "encryptionkey@0"
I20260807 06:21:35.971133 21863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:21:35.973516 21888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:35.974869 21863 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:35.975006 21863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "fe4c56df968749eda6facd4291744c7d"
format_stamp: "Formatted at 2026-08-07 06:21:35 on dist-test-slave-68xk"
server_key: "21ea8c20fdf69c625dbbe0054db37876"
server_key_iv: "f7e297df9fe97cd28da803c225f34551"
server_key_version: "encryptionkey@0"
I20260807 06:21:35.975107 21863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:35.994863 21863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:35.997995 21863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:35.998189 21863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:36.005858 21863 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:39123
I20260807 06:21:36.005839 21966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:39123 every 8 connection(s)
I20260807 06:21:36.007325 21863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:36.008303 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 21863
I20260807 06:21:36.008457 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:36.008812 27633 external_mini_cluster.cc:1428] Setting key 0bc0a60ad7dcb6487791ca2f6799525c
I20260807 06:21:36.010928 21969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:36.017931 21969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: Bootstrap starting.
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:36.020936 21969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:36.021921 21969 log.cc:824] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:36.024426 21969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: No bootstrap required, opened a new log
I20260807 06:21:36.025826 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.010388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.26.252.126:39123)
0807 06:21:36.010903 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.010925 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.010971 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:21:36.011825 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.011849 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.012272 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.012647 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:36.013378 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.014936 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.015840 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.016516 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.016699 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.020009 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:36.020015 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:36.020030 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:36.020062 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:36.022253 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.022859 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.022863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.022890 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.023041 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.023400 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.023403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.023405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.023914 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:36.024107 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.024469 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.024820 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":150,"threads_started":1}
I20260807 06:21:36.028349 21969 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } }
I20260807 06:21:36.028559 21969 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:36.028604 21969 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe4c56df968749eda6facd4291744c7d, State: Initialized, Role: FOLLOWER
I20260807 06:21:36.028951 21969 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } }
I20260807 06:21:36.029060 21969 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:36.029105 21969 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:36.029172 21969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:36.029994 21969 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } }
I20260807 06:21:36.030289 21969 leader_election.cc:302] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe4c56df968749eda6facd4291744c7d; no voters:
I20260807 06:21:36.030606 21969 leader_election.cc:288] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:36.030825 21974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:36.031107 21974 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [term 1 LEADER]: Becoming Leader. State: Replica: fe4c56df968749eda6facd4291744c7d, State: Running, Role: LEADER
I20260807 06:21:36.031468 21974 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } }
I20260807 06:21:36.031831 21969 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:36.033092 21976 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe4c56df968749eda6facd4291744c7d. Latest consensus state: current_term: 1 leader_uuid: "fe4c56df968749eda6facd4291744c7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } } }
I20260807 06:21:36.033239 21976 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:36.033630 21975 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe4c56df968749eda6facd4291744c7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe4c56df968749eda6facd4291744c7d" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 39123 } } }
I20260807 06:21:36.033718 21975 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d [sys.catalog]: This master's current role is: LEADER
W20260807 06:21:36.036798 21993 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:21:36.036865 21993 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:21:36.036947 21983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:36.037655 21983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:36.043391 21983 catalog_manager.cc:1347] Generated new cluster ID: a41e1d1e98f24819adbe1f18733f130a
I20260807 06:21:36.043457 21983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:36.049425 21983 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:36.050242 21983 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:36.058581 21983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: Generated new TSK 0
I20260807 06:21:36.059211 21983 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.252.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
Entry for principal kudu/127.26.252.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab.
I20260807 06:21:36.091358 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:36.204061 22002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:36.204355 22002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:36.204432 22002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:36.208482 22002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:36.208568 22002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:36.208662 22002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:36.214085 22002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.65.keytab
--principal=kudu/127.26.252.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:36.215209 22002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:36.216286 22002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:36.225732 22008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.225739 22009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.225754 22012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:36.226114 22002 server_base.cc:1034] running on GCE node
I20260807 06:21:36.226544 22002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:36.227133 22002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:36.228293 22002 hybrid_clock.cc:648] HybridClock initialized: now 1786083696228266 us; error 40 us; skew 500 ppm
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:36.231105 22002 init.cc:377] Logged in from keytab as kudu/127.26.252.65@KRBTEST.COM (short username kudu)
I20260807 06:21:36.231969 22002 webserver.cc:460] Webserver started at http://127.26.252.65:42381/ using document root <none> and password file <none>
I20260807 06:21:36.232566 22002 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:36.232630 22002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:36.232882 22002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:36.235018 22002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "a939c183143849c0b29b6594798bb43e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "5d6978447ff96b577d51b05fadbdc3d1"
server_key_iv: "c4324595d315f2a4627f8ab2fdf976fa"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.235584 22002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "a939c183143849c0b29b6594798bb43e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "5d6978447ff96b577d51b05fadbdc3d1"
server_key_iv: "c4324595d315f2a4627f8ab2fdf976fa"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.239284 22002 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:36.241619 22022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.242918 22002 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:36.243050 22002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "a939c183143849c0b29b6594798bb43e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "5d6978447ff96b577d51b05fadbdc3d1"
server_key_iv: "c4324595d315f2a4627f8ab2fdf976fa"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.243158 22002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:36.257742 22002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:36.260968 22002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:36.261224 22002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:36.261888 22002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:36.262893 22002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:36.262984 22002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.263065 22002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:36.263123 22002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.273116 22002 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:34109
I20260807 06:21:36.273147 22204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:34109 every 8 connection(s)
I20260807 06:21:36.274082 22002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:36.278529 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 22002
I20260807 06:21:36.278688 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:36.279085 27633 external_mini_cluster.cc:1428] Setting key 7743526e55d3417d577b9a758797e9fb
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.65@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.66@KRBTEST.COM; defaulting to no policy
I20260807 06:21:36.289988 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.275955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:33553 (local address 127.26.252.126:39123)
0807 06:21:36.276191 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.276196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.277061 (+ 865us) server_negotiation.cc:407] Connection header received
0807 06:21:36.278519 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.278524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.278593 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.278707 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:36.280076 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.280825 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.282283 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.282782 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.282925 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.285977 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:36.285981 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:36.285983 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:36.286010 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:36.287655 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.288240 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.288245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.288247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.288347 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.288740 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.288744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.288746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.288946 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:36.289063 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.289646 (+ 583us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.289796 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:21:36.290943 22208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.276404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39123 (local address 127.26.252.65:33553)
0807 06:21:36.276897 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.276943 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.278253 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.278928 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.278935 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.279408 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:36.279917 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.279938 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.280987 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.280992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.282144 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.282154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.282984 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.282990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.283232 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.283914 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:36.283940 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:36.285779 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:36.287798 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.287805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.287820 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.288120 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.288462 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.288465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.288467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.288627 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.289080 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:36.289089 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:36.289375 (+ 286us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.289590 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.289951 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":132,"threads_started":1}
I20260807 06:21:36.292474 22205 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39123
I20260807 06:21:36.292717 22205 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.66@KRBTEST.COM" created.
I20260807 06:21:36.293339 22205 heartbeater.cc:511] Master 127.26.252.126:39123 requested a full tablet report, sending...
I20260807 06:21:36.295068 21914 ts_manager.cc:194] Registered new tserver with Master: a939c183143849c0b29b6594798bb43e (127.26.252.65:34109)
I20260807 06:21:36.296725 21914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.65@KRBTEST.COM'} at 127.26.252.65:33553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
Entry for principal kudu/127.26.252.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab.
I20260807 06:21:36.310021 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:36.423935 22212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:36.424175 22212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:36.424216 22212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:36.428150 22212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:36.428200 22212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:36.428296 22212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:36.433842 22212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.66.keytab
--principal=kudu/127.26.252.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:36.434891 22212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:36.435931 22212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:36.445501 22217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.445534 22219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.445573 22221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:36.445706 22212 server_base.cc:1034] running on GCE node
I20260807 06:21:36.446213 22212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:36.446838 22212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:36.448052 22212 hybrid_clock.cc:648] HybridClock initialized: now 1786083696448034 us; error 33 us; skew 500 ppm
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:36.450911 22212 init.cc:377] Logged in from keytab as kudu/127.26.252.66@KRBTEST.COM (short username kudu)
I20260807 06:21:36.451838 22212 webserver.cc:460] Webserver started at http://127.26.252.66:35301/ using document root <none> and password file <none>
I20260807 06:21:36.452394 22212 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:36.452486 22212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:36.452720 22212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:36.454785 22212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "281e4e91813c4b94a6b7fdf66011c1a0"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "74b67b142ef9367d80d5caf7e7c77ec0"
server_key_iv: "5f0fb1dd2143712c8ea27d648b5383da"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.455354 22212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "281e4e91813c4b94a6b7fdf66011c1a0"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "74b67b142ef9367d80d5caf7e7c77ec0"
server_key_iv: "5f0fb1dd2143712c8ea27d648b5383da"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.459089 22212 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:36.461440 22238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.462715 22212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:36.462854 22212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "281e4e91813c4b94a6b7fdf66011c1a0"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "74b67b142ef9367d80d5caf7e7c77ec0"
server_key_iv: "5f0fb1dd2143712c8ea27d648b5383da"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.462962 22212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:36.482169 22212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:36.485574 22212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:36.485795 22212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:36.486474 22212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:36.487308 22212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:36.487388 22212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.487458 22212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:36.487509 22212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.496694 22212 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:33303
I20260807 06:21:36.496724 22403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:33303 every 8 connection(s)
I20260807 06:21:36.497560 22212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:36.507385 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 22212
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.66@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:36.507570 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:36.507869 27633 external_mini_cluster.cc:1428] Setting key 5e9c513e04d31c57aaffe0ddcded54ea
I20260807 06:21:36.511848 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.499481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:43955 (local address 127.26.252.126:39123)
0807 06:21:36.499660 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.499664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.500444 (+ 780us) server_negotiation.cc:407] Connection header received
0807 06:21:36.501869 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.501872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.501932 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.502049 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:36.503354 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.503942 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.505234 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.505486 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.505609 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.508185 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:36.508188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:36.508190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:36.508213 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:36.509661 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.510221 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.510238 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.510240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.510317 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.510735 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.510740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.510745 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.510931 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:36.511039 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.511555 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.511680 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:21:36.512705 22409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.499820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39123 (local address 127.26.252.66:43955)
0807 06:21:36.500266 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.500311 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.501647 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.502245 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.502252 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.502707 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:36.503192 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.503207 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.504106 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.504112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.505089 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.505099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.505662 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.505667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.505844 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.506432 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:36.506450 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:36.508001 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:36.509823 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.509829 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.509842 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.510103 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.510440 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.510443 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.510445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.510622 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.511055 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:36.511063 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:36.511307 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.511491 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.511814 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":104,"threads_started":1}
I20260807 06:21:36.513943 22405 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39123
I20260807 06:21:36.514186 22405 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:36.514720 22405 heartbeater.cc:511] Master 127.26.252.126:39123 requested a full tablet report, sending...
I20260807 06:21:36.515833 21914 ts_manager.cc:194] Registered new tserver with Master: 281e4e91813c4b94a6b7fdf66011c1a0 (127.26.252.66:33303)
I20260807 06:21:36.516814 21914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.66@KRBTEST.COM'} at 127.26.252.66:43955
WARNING: no policy specified for kudu/127.26.252.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
Entry for principal kudu/127.26.252.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab.
I20260807 06:21:36.537652 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:32889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:36.660077 22413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:36.660336 22413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:36.660378 22413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:36.664398 22413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:36.664451 22413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:36.664553 22413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:36.669849 22413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:32889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.67.keytab
--principal=kudu/127.26.252.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:39123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:36.670921 22413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:36.671917 22413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:36.681807 22424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.681869 22422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:36.681872 22420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:36.682266 22413 server_base.cc:1034] running on GCE node
I20260807 06:21:36.682760 22413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:36.683424 22413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:36.684638 22413 hybrid_clock.cc:648] HybridClock initialized: now 1786083696684597 us; error 55 us; skew 500 ppm
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:36.687562 22413 init.cc:377] Logged in from keytab as kudu/127.26.252.67@KRBTEST.COM (short username kudu)
I20260807 06:21:36.688364 22413 webserver.cc:460] Webserver started at http://127.26.252.67:40923/ using document root <none> and password file <none>
I20260807 06:21:36.688881 22413 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:36.688941 22413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:36.689103 22413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:36.691171 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "c3440e484421b005ab5c3a3bc522950f"
server_key_iv: "da0e1fad9fbcef7ed20530e5be4e39c9"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.691699 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "c3440e484421b005ab5c3a3bc522950f"
server_key_iv: "da0e1fad9fbcef7ed20530e5be4e39c9"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.695566 22413 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 06:21:36.698729 22437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.700531 22413 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:21:36.700697 22413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e"
format_stamp: "Formatted at 2026-08-07 06:21:36 on dist-test-slave-68xk"
server_key: "c3440e484421b005ab5c3a3bc522950f"
server_key_iv: "da0e1fad9fbcef7ed20530e5be4e39c9"
server_key_version: "encryptionkey@0"
I20260807 06:21:36.700841 22413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:36.729501 22413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:36.733150 22413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:36.733322 22413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:36.733942 22413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:36.734941 22413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:36.734992 22413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.735033 22413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:36.735049 22413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:36.744179 22413 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:33623
I20260807 06:21:36.744213 22608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:33623 every 8 connection(s)
I20260807 06:21:36.745203 22413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:36.754899 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 22413
I20260807 06:21:36.755076 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:36.755419 27633 external_mini_cluster.cc:1428] Setting key e96e24626e0b9a2f81761011ef08bf25
Aug 07 06:21:36 dist-test-slave-68xk krb5kdc[21845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083696, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.67@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:36.759896 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.747255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:59283 (local address 127.26.252.126:39123)
0807 06:21:36.747409 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.747412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.748421 (+ 1009us) server_negotiation.cc:407] Connection header received
0807 06:21:36.749816 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.749819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.749873 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.749959 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:36.751366 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.751912 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.753098 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.753357 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.753459 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.756272 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:36.756276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:36.756279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:36.756308 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:36.757922 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.758520 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.758523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.758524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.758599 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.758932 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.758934 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.758935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.759106 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:36.759180 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.759667 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.759776 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:21:36.760826 22611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.747681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:39123 (local address 127.26.252.67:59283)
0807 06:21:36.748207 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.748272 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.749585 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.750131 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.750138 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.750608 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:36.751209 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.751233 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.752027 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.752029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.752949 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.752958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.753509 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.753512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.753649 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.754265 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:21:36.754283 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:36.756094 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:36.758044 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.758049 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.758061 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.758360 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.758684 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:21:36.758686 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:21:36.758688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:21:36.758840 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:21:36.759203 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:36.759208 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:36.759443 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.759602 (+ 159us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.759887 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":177,"threads_started":1}
I20260807 06:21:36.761968 22609 heartbeater.cc:347] Connected to a master server at 127.26.252.126:39123
I20260807 06:21:36.762280 22609 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:36.763015 22609 heartbeater.cc:511] Master 127.26.252.126:39123 requested a full tablet report, sending...
I20260807 06:21:36.764186 21914 ts_manager.cc:194] Registered new tserver with Master: f3caeeb5820e4c38ae22ae6cc96b8b1e (127.26.252.67:33623)
I20260807 06:21:36.764950 21914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.252.67@KRBTEST.COM'} at 127.26.252.67:59283
I20260807 06:21:36.769724 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:36.779917 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.771833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44906 (local address 127.26.252.126:39123)
0807 06:21:36.771968 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.771972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.772145 (+ 173us) server_negotiation.cc:407] Connection header received
0807 06:21:36.772201 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.772203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.772245 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.772321 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:36.773009 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.773583 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.774404 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.774714 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.774811 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.776391 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:36.776394 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:36.776396 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:36.776421 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:36.777905 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.778485 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.778488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.778489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.778575 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:36.778918 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:36.778921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:36.778922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:36.779218 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:36.779335 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.779620 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.779773 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:21:36.782938 21914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:36.785959 21914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:36.801203 22624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.794919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:33623 (local address 127.0.0.1:60192)
0807 06:21:36.796044 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.796058 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.796146 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.796888 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.796891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.796914 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:36.797074 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.797081 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.798555 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.798558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.799507 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.799517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800649 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.800653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.800758 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.800784 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.800833 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.801010 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1060,"mutex_wait_us":23,"thread_start_us":119,"threads_started":1}
I20260807 06:21:36.801235 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.795550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38910 (local address 127.26.252.65:34109)
0807 06:21:36.795846 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.795853 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.796278 (+ 425us) server_negotiation.cc:407] Connection header received
0807 06:21:36.796373 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.796379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.796571 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.796714 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:36.797181 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.797899 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.799888 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800452 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.800583 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.800747 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.800947 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.801070 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":80,"threads_started":1}
I20260807 06:21:36.801222 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.794737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:33303 (local address 127.0.0.1:57100)
0807 06:21:36.795712 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.795785 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.795923 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.796656 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.796662 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.796685 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:36.796859 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.796870 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.798371 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.798378 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.799712 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.799718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800832 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.800839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.800925 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.800945 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.801018 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.801078 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":9,"thread_start_us":68,"threads_started":1}
I20260807 06:21:36.801540 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.794903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.26.252.66:33303)
0807 06:21:36.795381 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.795397 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.796186 (+ 789us) server_negotiation.cc:407] Connection header received
0807 06:21:36.796312 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.796320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.796500 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.796667 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:36.797005 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.798216 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.799855 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800668 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.800776 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.800927 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.801067 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.801172 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":133,"threads_started":1}
I20260807 06:21:36.801571 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.795147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:34109 (local address 127.0.0.1:38910)
0807 06:21:36.796159 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:36.796174 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:36.796275 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:36.796871 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:36.796874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:36.796893 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:36.797063 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.797069 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.798020 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.798027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.799705 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:36.799717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800584 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.800588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:36.800695 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.800734 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:21:36.800845 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 06:21:36.801452 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"mutex_wait_us":571,"spinlock_wait_cycles":7808,"thread_start_us":89,"threads_started":1}
I20260807 06:21:36.802886 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:36.795890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60192 (local address 127.26.252.67:33623)
0807 06:21:36.796439 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:36.796450 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:36.796471 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:21:36.796535 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:36.796539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:36.796708 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:36.796888 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:36.797207 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.798339 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.799641 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:36.800493 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:36.801647 (+ 1154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:36.802606 (+ 959us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:36.802658 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 06:21:36.802754 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":105,"threads_started":1}
I20260807 06:21:36.804564 22102 tablet_service.cc:1467] Processing CreateTablet for tablet ae395b1acedc4d6890132a6cb3cda49e (DEFAULT_TABLE table=test-table [id=59c087549c504ec49ce9d63cb5b7a963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:36.804591 22306 tablet_service.cc:1467] Processing CreateTablet for tablet ae395b1acedc4d6890132a6cb3cda49e (DEFAULT_TABLE table=test-table [id=59c087549c504ec49ce9d63cb5b7a963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:36.805630 22102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae395b1acedc4d6890132a6cb3cda49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:36.805639 22306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae395b1acedc4d6890132a6cb3cda49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:36.805498 22508 tablet_service.cc:1467] Processing CreateTablet for tablet ae395b1acedc4d6890132a6cb3cda49e (DEFAULT_TABLE table=test-table [id=59c087549c504ec49ce9d63cb5b7a963]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:36.806456 22508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae395b1acedc4d6890132a6cb3cda49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:36.811955 22633 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Bootstrap starting.
I20260807 06:21:36.813581 22634 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Bootstrap starting.
I20260807 06:21:36.813655 22635 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Bootstrap starting.
I20260807 06:21:36.815249 22633 tablet_bootstrap.cc:654] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:36.815718 22635 tablet_bootstrap.cc:654] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:36.815950 22634 tablet_bootstrap.cc:654] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:36.816313 22633 log.cc:824] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:36.816908 22635 log.cc:824] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:36.817339 22634 log.cc:824] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:36.818760 22633 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: No bootstrap required, opened a new log
I20260807 06:21:36.818988 22633 ts_tablet_manager.cc:1397] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260807 06:21:36.819096 22635 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: No bootstrap required, opened a new log
I20260807 06:21:36.819347 22635 ts_tablet_manager.cc:1397] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:21:36.819458 22634 tablet_bootstrap.cc:492] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: No bootstrap required, opened a new log
I20260807 06:21:36.819662 22634 ts_tablet_manager.cc:1397] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:21:36.822268 22635 raft_consensus.cc:348] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.822574 22635 raft_consensus.cc:374] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:36.822870 22635 raft_consensus.cc:729] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3caeeb5820e4c38ae22ae6cc96b8b1e, State: Initialized, Role: FOLLOWER
I20260807 06:21:36.823340 22635 consensus_queue.cc:260] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.824057 22609 heartbeater.cc:503] Master 127.26.252.126:39123 was elected leader, sending a full tablet report...
I20260807 06:21:36.823973 22634 raft_consensus.cc:348] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.824242 22634 raft_consensus.cc:374] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:36.824301 22634 raft_consensus.cc:729] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 281e4e91813c4b94a6b7fdf66011c1a0, State: Initialized, Role: FOLLOWER
I20260807 06:21:36.824424 22635 ts_tablet_manager.cc:1428] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:21:36.824788 22634 consensus_queue.cc:260] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.825278 22633 raft_consensus.cc:348] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.825522 22405 heartbeater.cc:503] Master 127.26.252.126:39123 was elected leader, sending a full tablet report...
I20260807 06:21:36.825554 22633 raft_consensus.cc:374] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:36.825615 22633 raft_consensus.cc:729] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a939c183143849c0b29b6594798bb43e, State: Initialized, Role: FOLLOWER
I20260807 06:21:36.825914 22634 ts_tablet_manager.cc:1428] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260807 06:21:36.826079 22633 consensus_queue.cc:260] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:36.827025 22205 heartbeater.cc:503] Master 127.26.252.126:39123 was elected leader, sending a full tablet report...
I20260807 06:21:36.827137 22633 ts_tablet_manager.cc:1428] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
W20260807 06:21:36.996227 22610 tablet.cc:2369] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:36.998867 22407 tablet.cc:2369] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:37.025628 22206 tablet.cc:2369] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:37.038195 22642 raft_consensus.cc:482] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:37.038400 22642 raft_consensus.cc:504] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:37.039705 22642 leader_election.cc:288] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 281e4e91813c4b94a6b7fdf66011c1a0 (127.26.252.66:33303), a939c183143849c0b29b6594798bb43e (127.26.252.65:34109)
I20260807 06:21:37.043818 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.040141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:36857 (local address 127.26.252.65:34109)
0807 06:21:37.040299 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.040305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.040321 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:21:37.040380 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.040382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.040427 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.040525 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:37.040819 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.041420 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.042732 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.043188 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.043330 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.043387 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.043583 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.043671 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:21:37.043817 22611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.039934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:34109 (local address 127.26.252.67:36857)
0807 06:21:37.040089 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:37.040108 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:37.040226 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:37.040537 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:37.040540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:37.040559 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:37.040693 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.040699 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.041543 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.041548 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.042579 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.042591 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.043325 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.043329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.043448 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.043466 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 06:21:37.043564 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:21:37.043641 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":24}
I20260807 06:21:37.043816 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.040125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:58901 (local address 127.26.252.66:33303)
0807 06:21:37.040265 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.040271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.040634 (+ 363us) server_negotiation.cc:407] Connection header received
0807 06:21:37.040809 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.040812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.040869 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.040954 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:37.041213 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.041733 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.042862 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.043264 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.043394 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.043445 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.043624 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.043695 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:21:37.043848 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.039934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:33303 (local address 127.26.252.67:58901)
0807 06:21:37.040528 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:37.040540 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:37.040677 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:37.040962 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:37.040965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:37.040981 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:37.041101 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.041106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.041848 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.041853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.042737 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.042746 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.043392 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.043396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.043493 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.043518 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:21:37.043605 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 06:21:37.043674 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":284,"thread_start_us":141,"threads_started":1}
I20260807 06:21:37.044473 22334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae395b1acedc4d6890132a6cb3cda49e" candidate_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" is_pre_election: true
I20260807 06:21:37.044473 22136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae395b1acedc4d6890132a6cb3cda49e" candidate_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a939c183143849c0b29b6594798bb43e" is_pre_election: true
I20260807 06:21:37.044775 22334 raft_consensus.cc:2454] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3caeeb5820e4c38ae22ae6cc96b8b1e in term 0.
I20260807 06:21:37.044775 22136 raft_consensus.cc:2454] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3caeeb5820e4c38ae22ae6cc96b8b1e in term 0.
I20260807 06:21:37.045290 22440 leader_election.cc:302] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a939c183143849c0b29b6594798bb43e, f3caeeb5820e4c38ae22ae6cc96b8b1e; no voters:
I20260807 06:21:37.045533 22642 raft_consensus.cc:2781] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:37.045617 22642 raft_consensus.cc:482] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:37.045693 22642 raft_consensus.cc:3037] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:37.047029 22642 raft_consensus.cc:504] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:37.047425 22642 leader_election.cc:288] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [CANDIDATE]: Term 1 election: Requested vote from peers 281e4e91813c4b94a6b7fdf66011c1a0 (127.26.252.66:33303), a939c183143849c0b29b6594798bb43e (127.26.252.65:34109)
I20260807 06:21:37.047848 22136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae395b1acedc4d6890132a6cb3cda49e" candidate_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a939c183143849c0b29b6594798bb43e"
I20260807 06:21:37.047873 22334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae395b1acedc4d6890132a6cb3cda49e" candidate_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "281e4e91813c4b94a6b7fdf66011c1a0"
I20260807 06:21:37.047955 22136 raft_consensus.cc:3037] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:37.048020 22334 raft_consensus.cc:3037] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:37.049072 22136 raft_consensus.cc:2454] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3caeeb5820e4c38ae22ae6cc96b8b1e in term 1.
I20260807 06:21:37.049190 22334 raft_consensus.cc:2454] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3caeeb5820e4c38ae22ae6cc96b8b1e in term 1.
I20260807 06:21:37.049414 22440 leader_election.cc:302] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a939c183143849c0b29b6594798bb43e, f3caeeb5820e4c38ae22ae6cc96b8b1e; no voters:
I20260807 06:21:37.049587 22642 raft_consensus.cc:2781] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:37.049821 22642 raft_consensus.cc:686] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 1 LEADER]: Becoming Leader. State: Replica: f3caeeb5820e4c38ae22ae6cc96b8b1e, State: Running, Role: LEADER
I20260807 06:21:37.050144 22642 consensus_queue.cc:237] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } }
I20260807 06:21:37.053426 21914 catalog_manager.cc:5495] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e reported cstate change: term changed from 0 to 1, leader changed from <none> to f3caeeb5820e4c38ae22ae6cc96b8b1e (127.26.252.67). New cstate: current_term: 1 leader_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3caeeb5820e4c38ae22ae6cc96b8b1e" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 33623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260807 06:21:37.102119 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.098293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60206 (local address 127.26.252.67:33623)
0807 06:21:37.098458 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.098462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.098475 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:21:37.098554 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.098556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.098649 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.098742 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:37.099024 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.099640 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.100524 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.100788 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.100884 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.101229 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:37.101684 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:37.101788 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.101901 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.101960 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:21:37.108736 22136 raft_consensus.cc:1261] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 1 FOLLOWER]: Refusing update from remote peer f3caeeb5820e4c38ae22ae6cc96b8b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:37.108765 22334 raft_consensus.cc:1261] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 1 FOLLOWER]: Refusing update from remote peer f3caeeb5820e4c38ae22ae6cc96b8b1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:37.109483 22642 consensus_queue.cc:1035] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a939c183143849c0b29b6594798bb43e" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:37.109791 22652 consensus_queue.cc:1035] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "281e4e91813c4b94a6b7fdf66011c1a0" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:37.118250 22657 mvcc.cc:205] Tried to move back new op lower bound from 7315798823349673984 to 7315798823120392192. Current Snapshot: MvccSnapshot[applied={T|T < 7315798823349673984}]
I20260807 06:21:37.121130 22661 mvcc.cc:205] Tried to move back new op lower bound from 7315798823349673984 to 7315798823120392192. Current Snapshot: MvccSnapshot[applied={T|T < 7315798823349673984 or (T in {7315798823349673984})}]
I20260807 06:21:37.127509 21914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:37.127712 21914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:37.130254 21914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe4c56df968749eda6facd4291744c7d: Sending DeleteTablet for 3 replicas of tablet ae395b1acedc4d6890132a6cb3cda49e
I20260807 06:21:37.131137 22306 tablet_service.cc:1514] Processing DeleteTablet for tablet ae395b1acedc4d6890132a6cb3cda49e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:37 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:57100
I20260807 06:21:37.131304 22102 tablet_service.cc:1514] Processing DeleteTablet for tablet ae395b1acedc4d6890132a6cb3cda49e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:37 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:38910
I20260807 06:21:37.131542 22508 tablet_service.cc:1514] Processing DeleteTablet for tablet ae395b1acedc4d6890132a6cb3cda49e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:37 UTC) from {username='kudu', principal='kudu/127.26.252.126@KRBTEST.COM'} at 127.0.0.1:60192
I20260807 06:21:37.131701 22672 tablet_replica.cc:330] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: stopping tablet replica
I20260807 06:21:37.131898 22674 tablet_replica.cc:330] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e: stopping tablet replica
I20260807 06:21:37.132144 22672 raft_consensus.cc:2229] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:37.132220 22674 raft_consensus.cc:2229] T ae395b1acedc4d6890132a6cb3cda49e P a939c183143849c0b29b6594798bb43e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:37.132355 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 22002
I20260807 06:21:37.132673 22672 raft_consensus.cc:2258] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:37.134595 22672 ts_tablet_manager.cc:1905] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:37.138254 22672 ts_tablet_manager.cc:1918] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:37.138382 22672 log.cc:1196] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/ae395b1acedc4d6890132a6cb3cda49e
I20260807 06:21:37.138741 22672 ts_tablet_manager.cc:1939] T ae395b1acedc4d6890132a6cb3cda49e P 281e4e91813c4b94a6b7fdf66011c1a0: Deleting consensus metadata
I20260807 06:21:37.140010 21892 catalog_manager.cc:4841] TS 281e4e91813c4b94a6b7fdf66011c1a0 (127.26.252.66:33303): tablet ae395b1acedc4d6890132a6cb3cda49e (table test-table [id=59c087549c504ec49ce9d63cb5b7a963]) successfully deleted
I20260807 06:21:37.145991 22676 tablet_replica.cc:330] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: stopping tablet replica
I20260807 06:21:37.146325 22676 raft_consensus.cc:2229] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:37.146718 22676 raft_consensus.cc:2258] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:37.148074 22676 ts_tablet_manager.cc:1905] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:37.150817 22676 ts_tablet_manager.cc:1918] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:37.150942 22676 log.cc:1196] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/ae395b1acedc4d6890132a6cb3cda49e
I20260807 06:21:37.151278 22676 ts_tablet_manager.cc:1939] T ae395b1acedc4d6890132a6cb3cda49e P f3caeeb5820e4c38ae22ae6cc96b8b1e: Deleting consensus metadata
I20260807 06:21:37.152426 21894 catalog_manager.cc:4841] TS f3caeeb5820e4c38ae22ae6cc96b8b1e (127.26.252.67:33623): tablet ae395b1acedc4d6890132a6cb3cda49e (table test-table [id=59c087549c504ec49ce9d63cb5b7a963]) successfully deleted
W20260807 06:21:37.154206 21893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:34109 (error 108)
I20260807 06:21:37.155313 22628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.155019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:34109 (local address 127.0.0.1:38918)
0807 06:21:37.155158 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:37.155233 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:34109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:21:37.155560 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 22212
W20260807 06:21:37.173074 21893 catalog_manager.cc:4584] TS a939c183143849c0b29b6594798bb43e (127.26.252.65:34109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae395b1acedc4d6890132a6cb3cda49e: Network error: Client connection negotiation failed: client connection to 127.26.252.65:34109: connect: Connection refused (error 111)
I20260807 06:21:37.181668 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 22413
I20260807 06:21:37.193148 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 21863
2026-08-07T06:21:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2725 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T06:21:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:37Z Disabled control of system clock
I20260807 06:21:37.229138 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:45405
--webserver_interface=127.26.252.126
--webserver_port=0
--builtin_ntp_servers=127.26.252.84:40035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:45405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:37.342316 22683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:37.342687 22683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:37.342759 22683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:37.346729 22683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:37.346812 22683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:37.346843 22683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:37.346880 22683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:37.346913 22683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:37.351691 22683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:40035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:45405
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:45405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:37.352783 22683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:37.354195 22683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:37.362751 22693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.362777 22690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.362763 22691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:37.362905 22683 server_base.cc:1034] running on GCE node
I20260807 06:21:37.363595 22683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:37.364779 22683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:37.366030 22683 hybrid_clock.cc:648] HybridClock initialized: now 1786083697366018 us; error 29 us; skew 500 ppm
I20260807 06:21:37.372951 22683 webserver.cc:460] Webserver started at http://127.26.252.126:34633/ using document root <none> and password file <none>
I20260807 06:21:37.373587 22683 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:37.373690 22683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:37.373951 22683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:37.376179 22683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "925dbaa5c93e4221acb80c94dff9f264"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "651dc920ecd5235f9255bb1223e3e37f"
server_key_iv: "ea15bc31b7dcad09ada9fd1c81db844d"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.376780 22683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "925dbaa5c93e4221acb80c94dff9f264"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "651dc920ecd5235f9255bb1223e3e37f"
server_key_iv: "ea15bc31b7dcad09ada9fd1c81db844d"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.380736 22683 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 06:21:37.383415 22702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.384819 22683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:21:37.384971 22683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "925dbaa5c93e4221acb80c94dff9f264"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "651dc920ecd5235f9255bb1223e3e37f"
server_key_iv: "ea15bc31b7dcad09ada9fd1c81db844d"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.385105 22683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:37.400601 22683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:37.401328 22683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:37.401543 22683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:37.409476 22683 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:45405
I20260807 06:21:37.409557 22785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:45405 every 8 connection(s)
I20260807 06:21:37.410578 22683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:37.414578 22788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:37.414981 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 22683
I20260807 06:21:37.415134 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:37.415452 27633 external_mini_cluster.cc:1428] Setting key 4f37e30ac6ff0975b87f913809c9c955
I20260807 06:21:37.421512 22788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: Bootstrap starting.
I20260807 06:21:37.424094 22788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:37.424960 22788 log.cc:824] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:37.425858 22792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.416987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.26.252.126:45405)
0807 06:21:37.417717 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.417733 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.417773 (+ 40us) server_negotiation.cc:407] Connection header received
0807 06:21:37.418640 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.418663 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.419083 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.419460 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:37.419923 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.420964 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.422015 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.422603 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.422795 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.423806 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:37.423810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:37.423823 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:37.424255 (+ 432us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:37.424332 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:37.424354 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:37.424468 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.424645 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.424902 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":155,"threads_started":1}
I20260807 06:21:37.427389 22788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: No bootstrap required, opened a new log
I20260807 06:21:37.431020 22788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } }
I20260807 06:21:37.431272 22788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:37.431357 22788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925dbaa5c93e4221acb80c94dff9f264, State: Initialized, Role: FOLLOWER
I20260807 06:21:37.431804 22788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } }
I20260807 06:21:37.431957 22788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:37.432047 22788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:37.432173 22788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:37.433079 22788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } }
I20260807 06:21:37.433414 22788 leader_election.cc:302] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 925dbaa5c93e4221acb80c94dff9f264; no voters:
I20260807 06:21:37.433734 22788 leader_election.cc:288] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:37.433903 22795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:37.434137 22795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [term 1 LEADER]: Becoming Leader. State: Replica: 925dbaa5c93e4221acb80c94dff9f264, State: Running, Role: LEADER
I20260807 06:21:37.434495 22795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } }
I20260807 06:21:37.435022 22788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:37.436116 22798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 925dbaa5c93e4221acb80c94dff9f264. Latest consensus state: current_term: 1 leader_uuid: "925dbaa5c93e4221acb80c94dff9f264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } } }
I20260807 06:21:37.436255 22798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:37.436594 22796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "925dbaa5c93e4221acb80c94dff9f264" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "925dbaa5c93e4221acb80c94dff9f264" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 45405 } } }
I20260807 06:21:37.436688 22796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:37.436833 22805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:37.439679 22805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:37.445029 22805 catalog_manager.cc:1347] Generated new cluster ID: 2eadfb83777b4a33aa9313f8aa688aab
I20260807 06:21:37.445116 22805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:37.469678 22805 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:37.470672 22805 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:37.478457 22805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: Generated new TSK 0
I20260807 06:21:37.479192 22805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:37.491389 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.65:0
--local_ip_for_outbound_sockets=127.26.252.65
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--builtin_ntp_servers=127.26.252.84:40035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 06:21:37.610441 22824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:37.610706 22824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:37.610744 22824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:37.614948 22824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:37.615000 22824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:37.615052 22824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.65
I20260807 06:21:37.619915 22824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:40035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.252.65
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.65
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:37.620914 22824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:37.622259 22824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:37.631680 22830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.631685 22833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.631711 22829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:37.632004 22824 server_base.cc:1034] running on GCE node
I20260807 06:21:37.632433 22824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:37.633095 22824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:37.634296 22824 hybrid_clock.cc:648] HybridClock initialized: now 1786083697634280 us; error 26 us; skew 500 ppm
I20260807 06:21:37.636289 22824 webserver.cc:460] Webserver started at http://127.26.252.65:43709/ using document root <none> and password file <none>
I20260807 06:21:37.636873 22824 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:37.636968 22824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:37.637210 22824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:37.639295 22824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data/instance:
uuid: "211c616a3a1e44d19c72879c0b6a047a"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "de904d46541e071a6dd858bdf1eeffad"
server_key_iv: "80ab826529a69b883587f4afa1aa873b"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.639858 22824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance:
uuid: "211c616a3a1e44d19c72879c0b6a047a"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "de904d46541e071a6dd858bdf1eeffad"
server_key_iv: "80ab826529a69b883587f4afa1aa873b"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.643612 22824 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:21:37.646509 22841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.647769 22824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:37.647869 22824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal
uuid: "211c616a3a1e44d19c72879c0b6a047a"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "de904d46541e071a6dd858bdf1eeffad"
server_key_iv: "80ab826529a69b883587f4afa1aa873b"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.647998 22824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:37.660846 22824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:37.661463 22824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:37.661661 22824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:37.662235 22824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:37.663206 22824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:37.663256 22824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.663322 22824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:37.663354 22824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.672539 22824 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.65:35291
I20260807 06:21:37.672569 23018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.65:35291 every 8 connection(s)
I20260807 06:21:37.673419 22824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/data/info.pb
I20260807 06:21:37.679536 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 22824
I20260807 06:21:37.679677 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-0/wal/instance
I20260807 06:21:37.679989 27633 external_mini_cluster.cc:1428] Setting key f4ba676c7e342d3047f27297dbc4d587
I20260807 06:21:37.681967 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.66:0
--local_ip_for_outbound_sockets=127.26.252.66
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--builtin_ntp_servers=127.26.252.84:40035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:37.683568 22792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.675292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:35059 (local address 127.26.252.126:45405)
0807 06:21:37.675438 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.675442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.676540 (+ 1098us) server_negotiation.cc:407] Connection header received
0807 06:21:37.678209 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.678213 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.678263 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.678340 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:37.679315 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.680143 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.681494 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.681720 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.681835 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.683064 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:37.683067 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:37.683070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:37.683083 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:37.683110 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:37.683119 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:37.683196 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.683363 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.683428 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:21:37.684450 23023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.675674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:45405 (local address 127.26.252.65:35059)
0807 06:21:37.676369 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:37.676410 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:37.677958 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:37.678551 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:37.678558 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:37.678643 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:37.679145 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.679159 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.680270 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.680273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.681365 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.681376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.681875 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.681879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.682086 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.682800 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:37.682802 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:37.682843 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:37.682904 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:37.683212 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:37.683224 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:37.683234 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 06:21:37.683362 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 06:21:37.683640 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":108,"threads_started":1}
I20260807 06:21:37.685721 23020 heartbeater.cc:347] Connected to a master server at 127.26.252.126:45405
I20260807 06:21:37.685966 23020 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:37.686654 23020 heartbeater.cc:511] Master 127.26.252.126:45405 requested a full tablet report, sending...
I20260807 06:21:37.688396 22723 ts_manager.cc:194] Registered new tserver with Master: 211c616a3a1e44d19c72879c0b6a047a (127.26.252.65:35291)
I20260807 06:21:37.689708 22723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.65:35059
W20260807 06:21:37.799676 23024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:37.799964 23024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:37.800037 23024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:37.804049 23024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:37.804126 23024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:37.804217 23024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.66
I20260807 06:21:37.809043 23024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:40035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.252.66
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.66
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:37.810177 23024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:37.811699 23024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:37.821628 23033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.821756 23034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:37.821625 23038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:37.822187 23024 server_base.cc:1034] running on GCE node
I20260807 06:21:37.822660 23024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:37.823318 23024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:37.824496 23024 hybrid_clock.cc:648] HybridClock initialized: now 1786083697824464 us; error 40 us; skew 500 ppm
I20260807 06:21:37.826869 23024 webserver.cc:460] Webserver started at http://127.26.252.66:44705/ using document root <none> and password file <none>
I20260807 06:21:37.827508 23024 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:37.827577 23024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:37.827821 23024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:37.830009 23024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data/instance:
uuid: "ec71883963084c439834a2a4507627f3"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "e354ecb59c8bdecf25ba63d8469eee21"
server_key_iv: "98770770de634d35ceba18956ab9c768"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.830685 23024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance:
uuid: "ec71883963084c439834a2a4507627f3"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "e354ecb59c8bdecf25ba63d8469eee21"
server_key_iv: "98770770de634d35ceba18956ab9c768"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.834717 23024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 06:21:37.837687 23048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.839154 23024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:37.839303 23024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal
uuid: "ec71883963084c439834a2a4507627f3"
format_stamp: "Formatted at 2026-08-07 06:21:37 on dist-test-slave-68xk"
server_key: "e354ecb59c8bdecf25ba63d8469eee21"
server_key_iv: "98770770de634d35ceba18956ab9c768"
server_key_version: "encryptionkey@0"
I20260807 06:21:37.839423 23024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:37.864586 23024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:37.865294 23024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:37.865465 23024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:37.866012 23024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:37.867187 23024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:37.867237 23024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.867280 23024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:37.867296 23024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:37.876813 23024 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.66:34189
I20260807 06:21:37.876863 23223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.66:34189 every 8 connection(s)
I20260807 06:21:37.877839 23024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/data/info.pb
I20260807 06:21:37.880121 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 23024
I20260807 06:21:37.880290 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal/instance
I20260807 06:21:37.880618 27633 external_mini_cluster.cc:1428] Setting key c97ec69fb6a1f4e50f9049f26cb4c40b
I20260807 06:21:37.882797 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.252.67:0
--local_ip_for_outbound_sockets=127.26.252.67
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--builtin_ntp_servers=127.26.252.84:40035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 06:21:37.888979 22792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.880060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.66:39215 (local address 127.26.252.126:45405)
0807 06:21:37.880237 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:37.880242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:37.881550 (+ 1308us) server_negotiation.cc:407] Connection header received
0807 06:21:37.883121 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:37.883127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:37.883192 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:37.883285 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:37.884184 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.884960 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.886794 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.887009 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.887089 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.888454 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:37.888457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:37.888459 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:37.888470 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:37.888487 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:37.888495 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:37.888554 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:37.888793 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 06:21:37.888860 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:21:37.890211 23227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:37.880552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:45405 (local address 127.26.252.66:39215)
0807 06:21:37.881386 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:37.881442 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:37.882820 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:37.883460 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:37.883467 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:37.883551 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:37.884036 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.884047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.885106 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.885111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.886651 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:37.886666 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:37.887166 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:37.887173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:37.887434 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:37.888131 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:37.888135 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:37.888196 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:37.888294 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:37.888588 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:37.888600 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:37.888609 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:21:37.888754 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 06:21:37.889078 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":181,"threads_started":1}
I20260807 06:21:37.891438 23224 heartbeater.cc:347] Connected to a master server at 127.26.252.126:45405
I20260807 06:21:37.891705 23224 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:37.892395 23224 heartbeater.cc:511] Master 127.26.252.126:45405 requested a full tablet report, sending...
I20260807 06:21:37.893618 22723 ts_manager.cc:194] Registered new tserver with Master: ec71883963084c439834a2a4507627f3 (127.26.252.66:34189)
I20260807 06:21:37.894203 22723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.66:39215
W20260807 06:21:37.999419 23231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:37.999734 23231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:37.999831 23231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:38.003849 23231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:38.003942 23231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:38.004038 23231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.252.67
I20260807 06:21:38.008880 23231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:40035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.252.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.252.67
--webserver_port=0
--tserver_master_addrs=127.26.252.126:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.252.67
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:38.010010 23231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:38.011507 23231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:38.021461 23244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:38.021472 23241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:38.021473 23240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:38.021507 23231 server_base.cc:1034] running on GCE node
I20260807 06:21:38.022081 23231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:38.022805 23231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:38.023967 23231 hybrid_clock.cc:648] HybridClock initialized: now 1786083698023950 us; error 30 us; skew 500 ppm
I20260807 06:21:38.025708 23231 webserver.cc:460] Webserver started at http://127.26.252.67:32887/ using document root <none> and password file <none>
I20260807 06:21:38.026288 23231 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:38.026350 23231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:38.026602 23231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:38.028587 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data/instance:
uuid: "21df14829a1e46f094d95333f0499b2b"
format_stamp: "Formatted at 2026-08-07 06:21:38 on dist-test-slave-68xk"
server_key: "5605db51150c53f6cf30ef803cfb7541"
server_key_iv: "513e392a6090a8d71f5750c94e877173"
server_key_version: "encryptionkey@0"
I20260807 06:21:38.029156 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance:
uuid: "21df14829a1e46f094d95333f0499b2b"
format_stamp: "Formatted at 2026-08-07 06:21:38 on dist-test-slave-68xk"
server_key: "5605db51150c53f6cf30ef803cfb7541"
server_key_iv: "513e392a6090a8d71f5750c94e877173"
server_key_version: "encryptionkey@0"
I20260807 06:21:38.032840 23231 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:21:38.035338 23253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:38.036680 23231 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:38.036830 23231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal
uuid: "21df14829a1e46f094d95333f0499b2b"
format_stamp: "Formatted at 2026-08-07 06:21:38 on dist-test-slave-68xk"
server_key: "5605db51150c53f6cf30ef803cfb7541"
server_key_iv: "513e392a6090a8d71f5750c94e877173"
server_key_version: "encryptionkey@0"
I20260807 06:21:38.036958 23231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:38.055713 23231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:38.056342 23231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:38.056538 23231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:38.057106 23231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:21:38.058010 23231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:21:38.058081 23231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:38.058152 23231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:21:38.058205 23231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:38.066897 23231 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.67:36979
I20260807 06:21:38.066928 23433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.67:36979 every 8 connection(s)
I20260807 06:21:38.067786 23231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/data/info.pb
I20260807 06:21:38.070964 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 23231
I20260807 06:21:38.071082 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal/instance
I20260807 06:21:38.071395 27633 external_mini_cluster.cc:1428] Setting key 7c2ff17b3f2679dce51ac5aa16d15f6b
I20260807 06:21:38.077410 22792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.069782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.67:60731 (local address 127.26.252.126:45405)
0807 06:21:38.069928 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.069931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.071030 (+ 1099us) server_negotiation.cc:407] Connection header received
0807 06:21:38.072601 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.072604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.072660 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.072738 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:38.073776 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.074308 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.075479 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.075716 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.075833 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.076888 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:38.076892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:38.076894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:38.076907 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:38.076936 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:38.076944 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:38.077024 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.077195 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.077258 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:21:38.078222 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.070211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:45405 (local address 127.26.252.67:60731)
0807 06:21:38.070877 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.070917 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.072399 (+ 1482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.072905 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.072932 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.073038 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:21:38.073637 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.073652 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.074458 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.074462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.075344 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.075354 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.075871 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.075875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.076045 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.076617 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:21:38.076619 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:21:38.076657 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:21:38.076720 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:21:38.077026 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:21:38.077038 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:21:38.077047 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.077188 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.077465 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":148,"threads_started":1}
I20260807 06:21:38.079373 23435 heartbeater.cc:347] Connected to a master server at 127.26.252.126:45405
I20260807 06:21:38.079651 23435 heartbeater.cc:464] Registering TS with master...
I20260807 06:21:38.080255 23435 heartbeater.cc:511] Master 127.26.252.126:45405 requested a full tablet report, sending...
I20260807 06:21:38.081414 22723 ts_manager.cc:194] Registered new tserver with Master: 21df14829a1e46f094d95333f0499b2b (127.26.252.67:36979)
I20260807 06:21:38.081959 22723 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.252.67:60731
I20260807 06:21:38.085685 27633 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:21:38.092046 22792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.088058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50590 (local address 127.26.252.126:45405)
0807 06:21:38.088263 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.088268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.088393 (+ 125us) server_negotiation.cc:407] Connection header received
0807 06:21:38.088555 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.088558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.088611 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.088697 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:38.088990 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.089509 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.090378 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.090691 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.090807 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.091605 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:38.091613 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:38.091616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:38.091627 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:38.091643 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:38.091651 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:38.091731 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.091844 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.091898 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260807 06:21:38.095232 22723 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:21:38.098503 22723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:21:38.114697 23453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.107625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35291 (local address 127.0.0.1:46946)
0807 06:21:38.108371 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.108427 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.108569 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.109433 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.109441 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.109466 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:38.109940 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.109949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111623 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.111627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.112914 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.112924 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.114012 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.114017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.114166 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114221 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.114352 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.114534 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":110,"thread_start_us":92,"threads_started":1}
I20260807 06:21:38.114739 23456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.107735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.26.252.65:35291)
0807 06:21:38.108461 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.108477 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.108510 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:21:38.108820 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.108826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.109044 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.109227 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:38.110096 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111483 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.113052 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.113873 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.113993 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114229 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.114397 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.114549 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":107,"threads_started":1}
I20260807 06:21:38.115449 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.108564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36822 (local address 127.26.252.67:36979)
0807 06:21:38.109085 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.109100 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.109127 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:21:38.109209 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.109214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.109413 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.109587 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:38.110096 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111461 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.113311 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.114154 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.114273 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114505 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.115141 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.115262 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":190,"threads_started":1}
I20260807 06:21:38.115034 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.107688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:36979 (local address 127.0.0.1:36822)
0807 06:21:38.108590 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.108606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.108720 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.109759 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.109763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.109784 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:38.109940 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.109949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111612 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.111615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.113165 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.113177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.114577 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.114581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.114697 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114722 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.114811 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.114888 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":213,"thread_start_us":125,"threads_started":1}
I20260807 06:21:38.115855 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.108703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34148 (local address 127.26.252.66:34189)
0807 06:21:38.109243 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.109256 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.109639 (+ 383us) server_negotiation.cc:407] Connection header received
0807 06:21:38.109712 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.109716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.109871 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.110035 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:38.110336 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111229 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.113500 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.114391 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.114519 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114708 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.115535 (+ 827us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.115666 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":168,"threads_started":1}
I20260807 06:21:38.115249 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.108266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:34189 (local address 127.0.0.1:34148)
0807 06:21:38.109397 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.109420 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.109515 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.110016 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.110074 (+ 58us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.110095 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:38.110200 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.110209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.111353 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.111360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.113373 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.113381 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.114786 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.114794 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.114925 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.114948 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.115026 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.115095 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1048,"mutex_wait_us":165,"thread_start_us":96,"threads_started":1}
I20260807 06:21:38.118719 23116 tablet_service.cc:1467] Processing CreateTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 (DEFAULT_TABLE table=test-table [id=7ee1e37cb637425b8fa54a56458dd64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:38.118763 23327 tablet_service.cc:1467] Processing CreateTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 (DEFAULT_TABLE table=test-table [id=7ee1e37cb637425b8fa54a56458dd64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:38.118733 22915 tablet_service.cc:1467] Processing CreateTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 (DEFAULT_TABLE table=test-table [id=7ee1e37cb637425b8fa54a56458dd64d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:21:38.119903 23116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7420d9d5d4dd499a89b8d849feb833c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:38.119906 23327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7420d9d5d4dd499a89b8d849feb833c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:38.120427 22915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7420d9d5d4dd499a89b8d849feb833c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:38.126474 23462 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Bootstrap starting.
I20260807 06:21:38.128345 23463 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Bootstrap starting.
I20260807 06:21:38.129114 23462 tablet_bootstrap.cc:654] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:38.129415 23465 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Bootstrap starting.
I20260807 06:21:38.130018 23462 log.cc:824] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:38.130474 23463 tablet_bootstrap.cc:654] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:38.131313 23463 log.cc:824] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:38.131919 23465 tablet_bootstrap.cc:654] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:38.132289 23462 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: No bootstrap required, opened a new log
I20260807 06:21:38.132513 23462 ts_tablet_manager.cc:1397] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 06:21:38.132742 23465 log.cc:824] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:38.133316 23463 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: No bootstrap required, opened a new log
I20260807 06:21:38.133492 23463 ts_tablet_manager.cc:1397] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 06:21:38.135006 23465 tablet_bootstrap.cc:492] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: No bootstrap required, opened a new log
I20260807 06:21:38.135213 23465 ts_tablet_manager.cc:1397] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 06:21:38.136732 23462 raft_consensus.cc:348] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.137023 23462 raft_consensus.cc:374] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:38.137086 23462 raft_consensus.cc:729] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec71883963084c439834a2a4507627f3, State: Initialized, Role: FOLLOWER
I20260807 06:21:38.137569 23462 consensus_queue.cc:260] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.138083 23463 raft_consensus.cc:348] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.138360 23463 raft_consensus.cc:374] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:38.138443 23463 raft_consensus.cc:729] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21df14829a1e46f094d95333f0499b2b, State: Initialized, Role: FOLLOWER
I20260807 06:21:38.138893 23462 ts_tablet_manager.cc:1428] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Time spent starting tablet: real 0.006s user 0.006s sys 0.002s
I20260807 06:21:38.138917 23463 consensus_queue.cc:260] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.139299 23224 heartbeater.cc:503] Master 127.26.252.126:45405 was elected leader, sending a full tablet report...
I20260807 06:21:38.139734 23435 heartbeater.cc:503] Master 127.26.252.126:45405 was elected leader, sending a full tablet report...
I20260807 06:21:38.139973 23463 ts_tablet_manager.cc:1428] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260807 06:21:38.141307 23465 raft_consensus.cc:348] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.141597 23465 raft_consensus.cc:374] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:38.141697 23465 raft_consensus.cc:729] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 211c616a3a1e44d19c72879c0b6a047a, State: Initialized, Role: FOLLOWER
I20260807 06:21:38.142192 23465 consensus_queue.cc:260] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.143316 23020 heartbeater.cc:503] Master 127.26.252.126:45405 was elected leader, sending a full tablet report...
I20260807 06:21:38.143373 23465 ts_tablet_manager.cc:1428] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260807 06:21:38.174594 23021 tablet.cc:2369] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:38.318804 23438 tablet.cc:2369] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:21:38.379155 23226 tablet.cc:2369] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:21:38.393126 23472 raft_consensus.cc:482] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:21:38.393354 23472 raft_consensus.cc:504] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.394493 23472 leader_election.cc:288] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21df14829a1e46f094d95333f0499b2b (127.26.252.67:36979), ec71883963084c439834a2a4507627f3 (127.26.252.66:34189)
I20260807 06:21:38.398846 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.394971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:50455 (local address 127.26.252.66:34189)
0807 06:21:38.395164 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.395170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.395321 (+ 151us) server_negotiation.cc:407] Connection header received
0807 06:21:38.395495 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.395498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.395550 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.395638 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:38.395908 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.396420 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.397635 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.398229 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.398371 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.398449 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.398645 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.398714 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:21:38.398846 23459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.395017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.252.65:46503 (local address 127.26.252.67:36979)
0807 06:21:38.395164 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.395169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.395464 (+ 295us) server_negotiation.cc:407] Connection header received
0807 06:21:38.395624 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.395627 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.395676 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.395763 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:21:38.396034 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.396525 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.397701 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.398295 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.398402 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.398473 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.398645 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.398714 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:21:38.398921 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.394835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.67:36979 (local address 127.26.252.65:46503)
0807 06:21:38.395351 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.395363 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.395497 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.395776 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.395779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.395796 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:38.395918 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.395923 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.396642 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.396647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.397534 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.397544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.398398 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.398401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.398505 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.398548 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.398614 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.398726 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":127,"thread_start_us":71,"threads_started":1}
I20260807 06:21:38.399302 23476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.394835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.66:34189 (local address 127.26.252.65:50455)
0807 06:21:38.395227 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.395239 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 06:21:38.395385 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:21:38.395652 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:21:38.395655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:21:38.395671 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:21:38.395797 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.395802 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.396537 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.396541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.397510 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:21:38.397519 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.398353 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.398357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:21:38.398492 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.398533 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:21:38.398614 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:21:38.398726 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":47,"thread_start_us":95,"threads_started":1}
I20260807 06:21:38.399592 23362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7420d9d5d4dd499a89b8d849feb833c0" candidate_uuid: "211c616a3a1e44d19c72879c0b6a047a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21df14829a1e46f094d95333f0499b2b" is_pre_election: true
I20260807 06:21:38.399924 23362 raft_consensus.cc:2454] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211c616a3a1e44d19c72879c0b6a047a in term 0.
I20260807 06:21:38.399942 23142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7420d9d5d4dd499a89b8d849feb833c0" candidate_uuid: "211c616a3a1e44d19c72879c0b6a047a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71883963084c439834a2a4507627f3" is_pre_election: true
I20260807 06:21:38.400210 23142 raft_consensus.cc:2454] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 211c616a3a1e44d19c72879c0b6a047a in term 0.
I20260807 06:21:38.400490 22848 leader_election.cc:302] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211c616a3a1e44d19c72879c0b6a047a, 21df14829a1e46f094d95333f0499b2b; no voters:
I20260807 06:21:38.400794 23472 raft_consensus.cc:2781] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:21:38.400894 23472 raft_consensus.cc:482] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:21:38.400954 23472 raft_consensus.cc:3037] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:38.402014 23472 raft_consensus.cc:504] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.402369 23472 leader_election.cc:288] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [CANDIDATE]: Term 1 election: Requested vote from peers 21df14829a1e46f094d95333f0499b2b (127.26.252.67:36979), ec71883963084c439834a2a4507627f3 (127.26.252.66:34189)
I20260807 06:21:38.402758 23142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7420d9d5d4dd499a89b8d849feb833c0" candidate_uuid: "211c616a3a1e44d19c72879c0b6a047a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec71883963084c439834a2a4507627f3"
I20260807 06:21:38.402873 23142 raft_consensus.cc:3037] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:38.403879 23142 raft_consensus.cc:2454] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211c616a3a1e44d19c72879c0b6a047a in term 1.
I20260807 06:21:38.404150 23362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7420d9d5d4dd499a89b8d849feb833c0" candidate_uuid: "211c616a3a1e44d19c72879c0b6a047a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21df14829a1e46f094d95333f0499b2b"
I20260807 06:21:38.404232 22847 leader_election.cc:302] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 211c616a3a1e44d19c72879c0b6a047a, ec71883963084c439834a2a4507627f3; no voters:
I20260807 06:21:38.404304 23362 raft_consensus.cc:3037] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:38.404402 23472 raft_consensus.cc:2781] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:38.404645 23472 raft_consensus.cc:686] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 1 LEADER]: Becoming Leader. State: Replica: 211c616a3a1e44d19c72879c0b6a047a, State: Running, Role: LEADER
I20260807 06:21:38.405010 23472 consensus_queue.cc:237] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } }
I20260807 06:21:38.405633 23362 raft_consensus.cc:2454] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 211c616a3a1e44d19c72879c0b6a047a in term 1.
I20260807 06:21:38.408617 22722 catalog_manager.cc:5495] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a reported cstate change: term changed from 0 to 1, leader changed from <none> to 211c616a3a1e44d19c72879c0b6a047a (127.26.252.65). New cstate: current_term: 1 leader_uuid: "211c616a3a1e44d19c72879c0b6a047a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "211c616a3a1e44d19c72879c0b6a047a" member_type: VOTER last_known_addr { host: "127.26.252.65" port: 35291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 } health_report { overall_health: UNKNOWN } } }
I20260807 06:21:38.478307 23456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.474566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46962 (local address 127.26.252.65:35291)
0807 06:21:38.474775 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:38.474779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:38.474794 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:21:38.474873 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:38.474875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:38.474956 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:38.475096 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:21:38.475288 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.475793 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.476638 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:38.476851 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:38.476933 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:38.477322 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:21:38.477774 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:21:38.477886 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:38.477980 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 06:21:38.478032 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 06:21:38.485018 23142 raft_consensus.cc:1261] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 1 FOLLOWER]: Refusing update from remote peer 211c616a3a1e44d19c72879c0b6a047a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:38.485018 23362 raft_consensus.cc:1261] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 1 FOLLOWER]: Refusing update from remote peer 211c616a3a1e44d19c72879c0b6a047a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:21:38.485972 23479 consensus_queue.cc:1035] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec71883963084c439834a2a4507627f3" member_type: VOTER last_known_addr { host: "127.26.252.66" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:38.486327 23472 consensus_queue.cc:1035] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21df14829a1e46f094d95333f0499b2b" member_type: VOTER last_known_addr { host: "127.26.252.67" port: 36979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:21:38.494783 23487 mvcc.cc:205] Tried to move back new op lower bound from 7315798828985421824 to 7315798828670271488. Current Snapshot: MvccSnapshot[applied={T|T < 7315798828985421824}]
I20260807 06:21:38.495769 23483 mvcc.cc:205] Tried to move back new op lower bound from 7315798828985421824 to 7315798828670271488. Current Snapshot: MvccSnapshot[applied={T|T < 7315798828985421824}]
I20260807 06:21:38.497632 23485 mvcc.cc:205] Tried to move back new op lower bound from 7315798828985421824 to 7315798828670271488. Current Snapshot: MvccSnapshot[applied={T|T < 7315798828985421824}]
I20260807 06:21:38.504166 22722 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:38.504341 22722 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:21:38.506726 22722 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 925dbaa5c93e4221acb80c94dff9f264: Sending DeleteTablet for 3 replicas of tablet 7420d9d5d4dd499a89b8d849feb833c0
I20260807 06:21:38.507463 22915 tablet_service.cc:1514] Processing DeleteTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:38 UTC) from {username='slave'} at 127.0.0.1:46946
I20260807 06:21:38.507584 23327 tablet_service.cc:1514] Processing DeleteTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:38 UTC) from {username='slave'} at 127.0.0.1:36822
I20260807 06:21:38.507652 23116 tablet_service.cc:1514] Processing DeleteTablet for tablet 7420d9d5d4dd499a89b8d849feb833c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:21:38 UTC) from {username='slave'} at 127.0.0.1:34148
I20260807 06:21:38.508104 23496 tablet_replica.cc:330] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a: stopping tablet replica
I20260807 06:21:38.508432 23496 raft_consensus.cc:2229] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:21:38.508452 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 22824
I20260807 06:21:38.508822 23496 raft_consensus.cc:2258] T 7420d9d5d4dd499a89b8d849feb833c0 P 211c616a3a1e44d19c72879c0b6a047a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:38.513430 23500 tablet_replica.cc:330] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: stopping tablet replica
I20260807 06:21:38.513731 23500 raft_consensus.cc:2229] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:38.513728 23497 tablet_replica.cc:330] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: stopping tablet replica
I20260807 06:21:38.514034 23500 raft_consensus.cc:2258] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:38.514019 23497 raft_consensus.cc:2229] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:21:38.514362 23497 raft_consensus.cc:2258] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:21:38.515631 23500 ts_tablet_manager.cc:1905] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:38.515831 23497 ts_tablet_manager.cc:1905] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:21:38.518113 23500 ts_tablet_manager.cc:1918] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:38.518229 23500 log.cc:1196] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-2/wal/wals/7420d9d5d4dd499a89b8d849feb833c0
I20260807 06:21:38.518586 23500 ts_tablet_manager.cc:1939] T 7420d9d5d4dd499a89b8d849feb833c0 P 21df14829a1e46f094d95333f0499b2b: Deleting consensus metadata
I20260807 06:21:38.518589 23497 ts_tablet_manager.cc:1918] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:21:38.518677 23497 log.cc:1196] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Deleting WAL directory at /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786083434177398-27633-0/minicluster-data/ts-1/wal/wals/7420d9d5d4dd499a89b8d849feb833c0
I20260807 06:21:38.518981 23497 ts_tablet_manager.cc:1939] T 7420d9d5d4dd499a89b8d849feb833c0 P ec71883963084c439834a2a4507627f3: Deleting consensus metadata
I20260807 06:21:38.519845 22707 catalog_manager.cc:4841] TS 21df14829a1e46f094d95333f0499b2b (127.26.252.67:36979): tablet 7420d9d5d4dd499a89b8d849feb833c0 (table test-table [id=7ee1e37cb637425b8fa54a56458dd64d]) successfully deleted
I20260807 06:21:38.520183 22705 catalog_manager.cc:4841] TS ec71883963084c439834a2a4507627f3 (127.26.252.66:34189): tablet 7420d9d5d4dd499a89b8d849feb833c0 (table test-table [id=7ee1e37cb637425b8fa54a56458dd64d]) successfully deleted
W20260807 06:21:38.520480 22704 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.252.65:35291 (error 108)
I20260807 06:21:38.521386 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 23024
I20260807 06:21:38.521639 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:38.521238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.65:35291 (local address 127.0.0.1:46970)
0807 06:21:38.521421 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 06:21:38.521526 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260807 06:21:38.523494 22704 catalog_manager.cc:4584] TS 211c616a3a1e44d19c72879c0b6a047a (127.26.252.65:35291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7420d9d5d4dd499a89b8d849feb833c0: Network error: Client connection negotiation failed: client connection to 127.26.252.65:35291: connect: Connection refused (error 111)
I20260807 06:21:38.534132 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 23231
I20260807 06:21:38.544497 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 22683
2026-08-07T06:21:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1353 ms)
[----------] 6 tests from EncryptionPolicyTest (12035 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:38 dist-test-slave-68xk krb5kdc[23506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:38 dist-test-slave-68xk krb5kdc[23506](info): set up 2 sockets
Aug 07 06:21:38 dist-test-slave-68xk krb5kdc[23506](info): commencing operation
krb5kdc: starting...
W20260807 06:21:39.789160 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:39 dist-test-slave-68xk krb5kdc[23506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:39.925212 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34133
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:40.039888 23527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:40.040196 23527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:40.040271 23527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:40.044296 23527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:40.044394 23527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:40.044432 23527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:40.044492 23527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:40.044529 23527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:40.049777 23527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34133
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:40.050918 23527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:40.051982 23527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:40.060671 23532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:40.060671 23533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:40.060726 23536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:40.060913 23527 server_base.cc:1034] running on GCE node
I20260807 06:21:40.061617 23527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:40.062781 23527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:40.063987 23527 hybrid_clock.cc:648] HybridClock initialized: now 1786083700063959 us; error 40 us; skew 500 ppm
Aug 07 06:21:40 dist-test-slave-68xk krb5kdc[23506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083700, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:40.066887 23527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:40.067780 23527 webserver.cc:460] Webserver started at http://127.0.0.1:41441/ using document root <none> and password file <none>
I20260807 06:21:40.068352 23527 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:40.068449 23527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:40.068688 23527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:40.070771 23527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "8530ac8df0a74a249ed32606defed767"
format_stamp: "Formatted at 2026-08-07 06:21:40 on dist-test-slave-68xk"
server_key: "47c6d03f4f5d631d7672f9ec2604521f"
server_key_iv: "8fa3e8c6d5a283405cfef691f8313121"
server_key_version: "encryptionkey@0"
I20260807 06:21:40.071360 23527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "8530ac8df0a74a249ed32606defed767"
format_stamp: "Formatted at 2026-08-07 06:21:40 on dist-test-slave-68xk"
server_key: "47c6d03f4f5d631d7672f9ec2604521f"
server_key_iv: "8fa3e8c6d5a283405cfef691f8313121"
server_key_version: "encryptionkey@0"
I20260807 06:21:40.075243 23527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:21:40.077725 23545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:40.079046 23527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:40.079195 23527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "8530ac8df0a74a249ed32606defed767"
format_stamp: "Formatted at 2026-08-07 06:21:40 on dist-test-slave-68xk"
server_key: "47c6d03f4f5d631d7672f9ec2604521f"
server_key_iv: "8fa3e8c6d5a283405cfef691f8313121"
server_key_version: "encryptionkey@0"
I20260807 06:21:40.079336 23527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:40.094748 23527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:40.097774 23527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:40.097985 23527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:40.105820 23527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34133
I20260807 06:21:40.105839 23630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34133 every 8 connection(s)
I20260807 06:21:40.106962 23527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:40.109845 23632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:40.112427 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 23527
I20260807 06:21:40.112572 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:40.112871 27633 external_mini_cluster.cc:1428] Setting key 6decfa15657749375c58d3c60c2e7835
I20260807 06:21:40.116025 23632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767: Bootstrap starting.
I20260807 06:21:40.118221 23632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:40.119076 23632 log.cc:824] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:40.121637 23632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767: No bootstrap required, opened a new log
Aug 07 06:21:40 dist-test-slave-68xk krb5kdc[23506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:21:40.125870 23632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260807 06:21:40.126181 23632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:40.126268 23632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8530ac8df0a74a249ed32606defed767, State: Initialized, Role: FOLLOWER
I20260807 06:21:40.126791 23632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260807 06:21:40.126950 23632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:40.127017 23632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:40.127123 23632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:40.128130 23632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260807 06:21:40.128471 23632 leader_election.cc:302] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8530ac8df0a74a249ed32606defed767; no voters:
I20260807 06:21:40.128777 23632 leader_election.cc:288] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:40.128863 23636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:40.114362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42273 (local address 127.0.0.1:34133)
0807 06:21:40.114814 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:40.114829 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:40.114865 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:21:40.115469 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:40.115485 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:40.115822 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:40.116153 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:40.116991 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:40.118012 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:40.119043 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:40.119778 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:40.119969 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:40.122915 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:40.122921 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:40.122938 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:40.122970 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:40.125510 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:40.126017 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:40.126023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:40.126028 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:40.126171 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:40.126628 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:40.126632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:40.126633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:40.127123 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:40.127373 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:40.127745 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 06:21:40.127964 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":119,"threads_started":1}
I20260807 06:21:40.128894 23638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:40.129113 23638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [term 1 LEADER]: Becoming Leader. State: Replica: 8530ac8df0a74a249ed32606defed767, State: Running, Role: LEADER
I20260807 06:21:40.129429 23638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } }
I20260807 06:21:40.130015 23632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:40.130633 23642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8530ac8df0a74a249ed32606defed767" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } } }
I20260807 06:21:40.130759 23642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:40.131012 23640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8530ac8df0a74a249ed32606defed767. Latest consensus state: current_term: 1 leader_uuid: "8530ac8df0a74a249ed32606defed767" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8530ac8df0a74a249ed32606defed767" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34133 } } }
I20260807 06:21:40.131110 23640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:40.131419 23647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:40.132478 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:40.135100 23647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:40.141001 23647 catalog_manager.cc:1347] Generated new cluster ID: b926d58a127d4c53873076d00739218b
I20260807 06:21:40.141067 23647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:40.147830 23636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:40.134660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41645 (local address 127.0.0.1:34133)
0807 06:21:40.134764 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:40.134769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:40.138708 (+ 3939us) server_negotiation.cc:407] Connection header received
0807 06:21:40.138865 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:40.138869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:40.138913 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:40.138989 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:40.139909 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:40.140726 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:40.142107 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:40.142471 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:40.142569 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:40.144281 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:40.144285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:40.144288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:40.144313 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:40.145973 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:40.146538 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:40.146541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:40.146543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:40.146624 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:40.146968 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:40.146971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:40.146972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:40.147155 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:40.147317 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:40.147591 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 06:21:40.147680 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:21:40.162401 23647 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:40.163625 23647 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:40.168915 23647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8530ac8df0a74a249ed32606defed767: Generated new TSK 0
I20260807 06:21:40.169739 23647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:40.177048 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 23527
W20260807 06:21:40.188244 23502 connection.cc:535] client connection to 127.0.0.1:34133 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34133): Connection reset by peer (error 104)
2026-08-07T06:21:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:40 dist-test-slave-68xk krb5kdc[23671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:40 dist-test-slave-68xk krb5kdc[23671](info): set up 2 sockets
Aug 07 06:21:40 dist-test-slave-68xk krb5kdc[23671](info): commencing operation
krb5kdc: starting...
W20260807 06:21:41.403745 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:41 dist-test-slave-68xk krb5kdc[23671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:41.535141 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41165
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:41.647193 23693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:41.647505 23693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:41.647590 23693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:41.651584 23693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:41.651674 23693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:41.651707 23693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:41.651755 23693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:41.651794 23693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:41.656981 23693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41165
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:41.658025 23693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:41.659051 23693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:41.667910 23701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:41.667927 23699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:41.667987 23693 server_base.cc:1034] running on GCE node
W20260807 06:21:41.667936 23698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:41.668737 23693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:41.669900 23693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:41.671178 23693 hybrid_clock.cc:648] HybridClock initialized: now 1786083701671149 us; error 38 us; skew 500 ppm
Aug 07 06:21:41 dist-test-slave-68xk krb5kdc[23671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083701, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:41.674265 23693 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:41.675254 23693 webserver.cc:460] Webserver started at http://127.0.0.1:40005/ using document root <none> and password file <none>
I20260807 06:21:41.675863 23693 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:41.675961 23693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:41.676203 23693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:41.678313 23693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "a5507d1311994a68bc256f978ff733c5"
format_stamp: "Formatted at 2026-08-07 06:21:41 on dist-test-slave-68xk"
server_key: "e08b6782ceebe830f37a15e053a4097f"
server_key_iv: "bd814b70d04ccdc0dbdf9073b3d6f2a8"
server_key_version: "encryptionkey@0"
I20260807 06:21:41.678983 23693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "a5507d1311994a68bc256f978ff733c5"
format_stamp: "Formatted at 2026-08-07 06:21:41 on dist-test-slave-68xk"
server_key: "e08b6782ceebe830f37a15e053a4097f"
server_key_iv: "bd814b70d04ccdc0dbdf9073b3d6f2a8"
server_key_version: "encryptionkey@0"
I20260807 06:21:41.682910 23693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:21:41.685439 23713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:41.686791 23693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:41.686939 23693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "a5507d1311994a68bc256f978ff733c5"
format_stamp: "Formatted at 2026-08-07 06:21:41 on dist-test-slave-68xk"
server_key: "e08b6782ceebe830f37a15e053a4097f"
server_key_iv: "bd814b70d04ccdc0dbdf9073b3d6f2a8"
server_key_version: "encryptionkey@0"
I20260807 06:21:41.687052 23693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:41.705097 23693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:41.708281 23693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:41.708500 23693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:41.717388 23693 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41165
I20260807 06:21:41.717509 23789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41165 every 8 connection(s)
I20260807 06:21:41.718626 23693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:41.721535 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 23693
I20260807 06:21:41.721711 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:41.722146 27633 external_mini_cluster.cc:1428] Setting key caa14da8e4c1c21ad9503fca798e2355
I20260807 06:21:41.724468 23793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:41.731490 23793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5: Bootstrap starting.
I20260807 06:21:41.732887 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:41.723858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60681 (local address 127.0.0.1:41165)
0807 06:21:41.724299 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:41.724320 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:41.724365 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:21:41.725221 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:41.725254 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:41.725673 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:41.726032 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:41.726489 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:41.727983 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:41.728959 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:41.729647 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:41.729814 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:41.730812 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:41.730819 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:41.730834 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:41.731332 (+ 498us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:41.731399 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:41.731430 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:41.731568 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:41.731830 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 06:21:41.731961 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":116,"threads_started":1}
I20260807 06:21:41.734103 23793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:41.735070 23793 log.cc:824] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:41.736232 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:41.737238 23793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5: No bootstrap required, opened a new log
I20260807 06:21:41.741714 23793 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } }
I20260807 06:21:41.742014 23793 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:41.742113 23793 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5507d1311994a68bc256f978ff733c5, State: Initialized, Role: FOLLOWER
I20260807 06:21:41.742666 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:41.738321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34259 (local address 127.0.0.1:41165)
0807 06:21:41.738477 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:41.738481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:41.738656 (+ 175us) server_negotiation.cc:407] Connection header received
0807 06:21:41.738769 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:41.738771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:41.738807 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:41.738871 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:41.739176 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:41.739697 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:41.740868 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:41.741067 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:41.741145 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:41.742014 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:41.742019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:41.742025 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:41.742040 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:41.742075 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:41.742106 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:41.742264 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:41.742458 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 06:21:41.742503 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:21:41.742619 23793 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } }
I20260807 06:21:41.742815 23793 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:41.742882 23793 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:41.742985 23793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:41.744012 23793 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } }
I20260807 06:21:41.744305 23793 leader_election.cc:302] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5507d1311994a68bc256f978ff733c5; no voters:
I20260807 06:21:41.744551 23793 leader_election.cc:288] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:41.744645 23805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:41.744943 23805 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [term 1 LEADER]: Becoming Leader. State: Replica: a5507d1311994a68bc256f978ff733c5, State: Running, Role: LEADER
I20260807 06:21:41.745328 23805 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } }
I20260807 06:21:41.745908 23793 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:41.746562 23805 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5507d1311994a68bc256f978ff733c5. Latest consensus state: current_term: 1 leader_uuid: "a5507d1311994a68bc256f978ff733c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } } }
I20260807 06:21:41.746677 23805 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:41.747234 23807 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5507d1311994a68bc256f978ff733c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5507d1311994a68bc256f978ff733c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41165 } } }
I20260807 06:21:41.747349 23807 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:41.747607 23820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:41.750490 23820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:41.755589 23820 catalog_manager.cc:1347] Generated new cluster ID: a40cc39281f64db19f2be5993f9db408
I20260807 06:21:41.755656 23820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:41.760411 23820 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:41.761220 23820 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:41.772015 23820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5507d1311994a68bc256f978ff733c5: Generated new TSK 0
I20260807 06:21:41.772660 23820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:41.777758 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 23693
W20260807 06:21:41.788151 23669 connection.cc:535] client connection to 127.0.0.1:41165 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41165): Connection reset by peer (error 104)
2026-08-07T06:21:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1599 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:41 dist-test-slave-68xk krb5kdc[23837](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:41 dist-test-slave-68xk krb5kdc[23837](info): set up 2 sockets
Aug 07 06:21:41 dist-test-slave-68xk krb5kdc[23837](info): commencing operation
krb5kdc: starting...
W20260807 06:21:42.997738 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:43 dist-test-slave-68xk krb5kdc[23837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:43.133426 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45951
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:43.249686 23855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:43.249966 23855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:43.250041 23855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:43.253988 23855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:43.254081 23855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:43.254119 23855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:43.254177 23855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:43.254217 23855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:43.259389 23855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45951
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:43.260408 23855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:43.261409 23855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:43.269987 23872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:43.270030 23867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:43.270004 23866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:43.270299 23855 server_base.cc:1034] running on GCE node
I20260807 06:21:43.270876 23855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:43.271950 23855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:43.273217 23855 hybrid_clock.cc:648] HybridClock initialized: now 1786083703273212 us; error 38 us; skew 500 ppm
Aug 07 06:21:43 dist-test-slave-68xk krb5kdc[23837](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083703, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:43.280025 23855 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:43.280937 23855 webserver.cc:460] Webserver started at http://127.0.0.1:44149/ using document root <none> and password file <none>
I20260807 06:21:43.281495 23855 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:43.281559 23855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:43.281733 23855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:43.283960 23855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "0b9c922e787e4c5cb784a5c0347dd720"
format_stamp: "Formatted at 2026-08-07 06:21:43 on dist-test-slave-68xk"
server_key: "d82ad0881b5562f32b32eeb469751ded"
server_key_iv: "0780c3784c2092fc1ed4652c42683cd0"
server_key_version: "encryptionkey@0"
I20260807 06:21:43.284560 23855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "0b9c922e787e4c5cb784a5c0347dd720"
format_stamp: "Formatted at 2026-08-07 06:21:43 on dist-test-slave-68xk"
server_key: "d82ad0881b5562f32b32eeb469751ded"
server_key_iv: "0780c3784c2092fc1ed4652c42683cd0"
server_key_version: "encryptionkey@0"
I20260807 06:21:43.288560 23855 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:43.291049 23884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:43.292337 23855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:43.292446 23855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "0b9c922e787e4c5cb784a5c0347dd720"
format_stamp: "Formatted at 2026-08-07 06:21:43 on dist-test-slave-68xk"
server_key: "d82ad0881b5562f32b32eeb469751ded"
server_key_iv: "0780c3784c2092fc1ed4652c42683cd0"
server_key_version: "encryptionkey@0"
I20260807 06:21:43.292531 23855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:43.297286 23855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:43.300316 23855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:43.300468 23855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:43.308087 23855 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45951
I20260807 06:21:43.308097 23957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45951 every 8 connection(s)
I20260807 06:21:43.309072 23855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:43.309762 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 23855
I20260807 06:21:43.309942 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:43.310237 27633 external_mini_cluster.cc:1428] Setting key f200faa2317f48d90118c49e435f37c7
I20260807 06:21:43.313189 23958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:43.315335 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:43.311582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38605 (local address 127.0.0.1:45951)
0807 06:21:43.312009 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:43.312024 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:43.312059 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:21:43.312749 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:43.312766 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:43.313037 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:43.313387 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:43.314184 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:43.314188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:43.314200 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:43.314210 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:43.314261 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:43.314280 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:43.314448 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:43.314525 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:21:43.314684 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":117,"threads_started":1}
I20260807 06:21:43.318406 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:43.320107 23958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: Bootstrap starting.
I20260807 06:21:43.323093 23958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:43.323257 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:43.320809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59553 (local address 127.0.0.1:45951)
0807 06:21:43.320938 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:43.320943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:43.321410 (+ 467us) server_negotiation.cc:407] Connection header received
0807 06:21:43.321460 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:43.321463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:43.321516 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:43.321608 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:43.322682 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:43.322686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:43.322689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:43.322751 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:43.322786 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:43.322801 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:43.322891 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:43.323033 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 06:21:43.323065 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:21:43.324131 23958 log.cc:824] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:43.326284 23958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: No bootstrap required, opened a new log
I20260807 06:21:43.329797 23958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } }
I20260807 06:21:43.330039 23958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:43.330124 23958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b9c922e787e4c5cb784a5c0347dd720, State: Initialized, Role: FOLLOWER
I20260807 06:21:43.330597 23958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } }
I20260807 06:21:43.330754 23958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:43.330833 23958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:43.330967 23958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:43.331836 23958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } }
I20260807 06:21:43.332180 23958 leader_election.cc:302] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b9c922e787e4c5cb784a5c0347dd720; no voters:
I20260807 06:21:43.332485 23958 leader_election.cc:288] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:43.332770 23973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:43.333060 23973 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [term 1 LEADER]: Becoming Leader. State: Replica: 0b9c922e787e4c5cb784a5c0347dd720, State: Running, Role: LEADER
I20260807 06:21:43.333564 23973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } }
I20260807 06:21:43.333774 23958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:43.335686 23976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b9c922e787e4c5cb784a5c0347dd720. Latest consensus state: current_term: 1 leader_uuid: "0b9c922e787e4c5cb784a5c0347dd720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } } }
I20260807 06:21:43.335717 23974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b9c922e787e4c5cb784a5c0347dd720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b9c922e787e4c5cb784a5c0347dd720" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45951 } } }
I20260807 06:21:43.335810 23976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:43.335819 23974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720 [sys.catalog]: This master's current role is: LEADER
W20260807 06:21:43.338790 23999 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:21:43.338882 23999 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:21:43.338939 24000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:43.339617 24000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:43.344646 24000 catalog_manager.cc:1347] Generated new cluster ID: f68dc658cd734cc586f7fecb500629a8
I20260807 06:21:43.344710 24000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:43.368721 24000 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:43.369059 24000 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:43.375721 24000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b9c922e787e4c5cb784a5c0347dd720: Generated new TSK 0
I20260807 06:21:43.376390 24000 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:43.386008 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 23855
2026-08-07T06:21:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:43 dist-test-slave-68xk krb5kdc[24009](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:43 dist-test-slave-68xk krb5kdc[24009](info): set up 2 sockets
Aug 07 06:21:43 dist-test-slave-68xk krb5kdc[24009](info): commencing operation
krb5kdc: starting...
W20260807 06:21:44.673648 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:44 dist-test-slave-68xk krb5kdc[24009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:44.809717 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39071
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:44.922003 24028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:44.922318 24028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:44.922394 24028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:44.926398 24028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:44.926476 24028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:44.926496 24028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:44.926513 24028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:44.926528 24028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:44.931747 24028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:44.932873 24028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:44.933957 24028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:44.942670 24038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:44.942659 24037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:44.942659 24041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:44.943007 24028 server_base.cc:1034] running on GCE node
I20260807 06:21:44.943648 24028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:44.944763 24028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:44.945973 24028 hybrid_clock.cc:648] HybridClock initialized: now 1786083704945947 us; error 39 us; skew 500 ppm
Aug 07 06:21:44 dist-test-slave-68xk krb5kdc[24009](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:44.949070 24028 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:44.950101 24028 webserver.cc:460] Webserver started at http://127.0.0.1:42201/ using document root <none> and password file <none>
I20260807 06:21:44.950819 24028 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:44.950923 24028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:44.951200 24028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:44.953424 24028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "90ba97c5e7754dd2874034b217a3ef2c"
format_stamp: "Formatted at 2026-08-07 06:21:44 on dist-test-slave-68xk"
server_key: "fcae0b614859f9b59cb82ea64bc64908"
server_key_iv: "e22edf1ed2f83cac2ed793b0765fb29e"
server_key_version: "encryptionkey@0"
I20260807 06:21:44.954052 24028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "90ba97c5e7754dd2874034b217a3ef2c"
format_stamp: "Formatted at 2026-08-07 06:21:44 on dist-test-slave-68xk"
server_key: "fcae0b614859f9b59cb82ea64bc64908"
server_key_iv: "e22edf1ed2f83cac2ed793b0765fb29e"
server_key_version: "encryptionkey@0"
I20260807 06:21:44.958017 24028 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 06:21:44.960702 24049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:44.961956 24028 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:44.962248 24028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "90ba97c5e7754dd2874034b217a3ef2c"
format_stamp: "Formatted at 2026-08-07 06:21:44 on dist-test-slave-68xk"
server_key: "fcae0b614859f9b59cb82ea64bc64908"
server_key_iv: "e22edf1ed2f83cac2ed793b0765fb29e"
server_key_version: "encryptionkey@0"
I20260807 06:21:44.962373 24028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:44.971989 24028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:44.974895 24028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:44.975102 24028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:44.982316 24028 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39071
I20260807 06:21:44.982327 24126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39071 every 8 connection(s)
I20260807 06:21:44.983305 24028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:44.986156 24127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:44.986541 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24028
I20260807 06:21:44.986699 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:44.987036 27633 external_mini_cluster.cc:1428] Setting key d684214b6273d39fb692048c61ec6322
I20260807 06:21:44.993254 24127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c: Bootstrap starting.
I20260807 06:21:44.996146 24127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c: Neither blocks nor log segments found. Creating new log.
Aug 07 06:21:44 dist-test-slave-68xk krb5kdc[24009](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:21:44.996971 24127 log.cc:824] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:44.999069 24127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c: No bootstrap required, opened a new log
I20260807 06:21:45.002832 24132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:44.988440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51733 (local address 127.0.0.1:39071)
0807 06:21:44.988921 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:44.988947 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:44.988987 (+ 40us) server_negotiation.cc:407] Connection header received
0807 06:21:44.989753 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:44.989769 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:44.990130 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:44.990478 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:44.991369 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:44.992481 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:44.993655 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:44.994166 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:44.994296 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:44.997449 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:44.997454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:44.997468 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:44.997499 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:44.999625 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:45.000152 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:45.000158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:45.000163 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:45.000284 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:45.000612 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:45.000618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:45.000623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:45.001049 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:45.001290 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:45.001610 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 06:21:45.001937 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":192,"threads_started":1}
I20260807 06:21:45.002774 24127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260807 06:21:45.003074 24127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:45.003159 24127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ba97c5e7754dd2874034b217a3ef2c, State: Initialized, Role: FOLLOWER
I20260807 06:21:45.003619 24127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260807 06:21:45.003786 24127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:45.003862 24127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:45.003961 24127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:45.005312 24127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260807 06:21:45.005721 24127 leader_election.cc:302] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90ba97c5e7754dd2874034b217a3ef2c; no voters:
I20260807 06:21:45.006145 24127 leader_election.cc:288] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:45.006330 24135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:45.006655 24135 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [term 1 LEADER]: Becoming Leader. State: Replica: 90ba97c5e7754dd2874034b217a3ef2c, State: Running, Role: LEADER
I20260807 06:21:45.007009 24135 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } }
I20260807 06:21:45.007748 24127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:45.008610 24135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90ba97c5e7754dd2874034b217a3ef2c. Latest consensus state: current_term: 1 leader_uuid: "90ba97c5e7754dd2874034b217a3ef2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } } }
I20260807 06:21:45.008744 24135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:45.009205 24144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:45.010473 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:45.011184 24138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90ba97c5e7754dd2874034b217a3ef2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ba97c5e7754dd2874034b217a3ef2c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39071 } } }
I20260807 06:21:45.011302 24138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:45.013993 24144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:45.020601 24144 catalog_manager.cc:1347] Generated new cluster ID: b732fa1d476942158232c5535517caa7
I20260807 06:21:45.020673 24144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:45.024693 24132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:45.014922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56521 (local address 127.0.0.1:39071)
0807 06:21:45.015157 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:45.015164 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:45.015850 (+ 686us) server_negotiation.cc:407] Connection header received
0807 06:21:45.015983 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:45.015986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:45.016042 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:45.016138 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:45.017012 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:45.017599 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:45.018558 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:45.018951 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:45.019067 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:45.020915 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:45.020920 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:45.020922 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:45.020949 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:45.022827 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:45.023339 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:45.023344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:45.023346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:45.023440 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:45.023745 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:45.023748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:45.023750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:45.023972 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:45.024114 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:45.024366 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 06:21:45.024493 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260807 06:21:45.031386 24144 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:45.032352 24144 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:45.043200 24144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90ba97c5e7754dd2874034b217a3ef2c: Generated new TSK 0
I20260807 06:21:45.043869 24144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:45.054976 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24028
2026-08-07T06:21:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1674 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:45 dist-test-slave-68xk krb5kdc[24170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:45 dist-test-slave-68xk krb5kdc[24170](info): set up 2 sockets
Aug 07 06:21:45 dist-test-slave-68xk krb5kdc[24170](info): commencing operation
krb5kdc: starting...
W20260807 06:21:46.263056 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:46 dist-test-slave-68xk krb5kdc[24170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:46.393217 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:46.503477 24188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:46.503793 24188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:46.503876 24188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:46.507959 24188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:46.508049 24188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:46.508088 24188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:46.508145 24188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:46.508180 24188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:46.513306 24188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:46.514341 24188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:46.515362 24188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:46.523770 24196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:46.523759 24201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:46.523765 24197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:46.524128 24188 server_base.cc:1034] running on GCE node
I20260807 06:21:46.524647 24188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:46.525799 24188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:46.527019 24188 hybrid_clock.cc:648] HybridClock initialized: now 1786083706526991 us; error 43 us; skew 500 ppm
Aug 07 06:21:46 dist-test-slave-68xk krb5kdc[24170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083706, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:46.530193 24188 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:46.531204 24188 webserver.cc:460] Webserver started at http://127.0.0.1:33937/ using document root <none> and password file <none>
I20260807 06:21:46.531812 24188 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:46.531881 24188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:46.532142 24188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:46.534332 24188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "32a8073d4ddd47aea69f76c98e12c007"
format_stamp: "Formatted at 2026-08-07 06:21:46 on dist-test-slave-68xk"
server_key: "4be1066ff3ca602b0a2a37365a7f17aa"
server_key_iv: "d74f3d1e1714bfa41cee656631f193c7"
server_key_version: "encryptionkey@0"
I20260807 06:21:46.535018 24188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "32a8073d4ddd47aea69f76c98e12c007"
format_stamp: "Formatted at 2026-08-07 06:21:46 on dist-test-slave-68xk"
server_key: "4be1066ff3ca602b0a2a37365a7f17aa"
server_key_iv: "d74f3d1e1714bfa41cee656631f193c7"
server_key_version: "encryptionkey@0"
I20260807 06:21:46.539134 24188 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:21:46.541807 24214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:46.543282 24188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:46.543442 24188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "32a8073d4ddd47aea69f76c98e12c007"
format_stamp: "Formatted at 2026-08-07 06:21:46 on dist-test-slave-68xk"
server_key: "4be1066ff3ca602b0a2a37365a7f17aa"
server_key_iv: "d74f3d1e1714bfa41cee656631f193c7"
server_key_version: "encryptionkey@0"
I20260807 06:21:46.543543 24188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:46.569307 24188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:46.572456 24188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:46.572686 24188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:46.580688 24188 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46245
I20260807 06:21:46.580719 24292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46245 every 8 connection(s)
I20260807 06:21:46.581749 24188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:46.584681 24293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:46.590090 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24188
I20260807 06:21:46.590250 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:46.590582 27633 external_mini_cluster.cc:1428] Setting key 61cb2c45d9e04a0120001d1c70553d80
I20260807 06:21:46.590600 24293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007: Bootstrap starting.
I20260807 06:21:46.593220 24293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:46.593997 24293 log.cc:824] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:46.595957 24293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007: No bootstrap required, opened a new log
I20260807 06:21:46.599880 24297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:46.592123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48959 (local address 127.0.0.1:46245)
0807 06:21:46.592601 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:46.592616 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:46.592658 (+ 42us) server_negotiation.cc:407] Connection header received
0807 06:21:46.593295 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:46.593312 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:46.593714 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:46.594051 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:46.594577 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:46.595639 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:46.596606 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:46.597061 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:46.597247 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:46.598133 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:46.598138 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:46.598155 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:46.598613 (+ 458us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:46.598669 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:46.598692 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:46.598796 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:46.598971 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 06:21:46.599175 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":139,"threads_started":1}
I20260807 06:21:46.599818 24293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260807 06:21:46.600111 24293 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:46.600211 24293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32a8073d4ddd47aea69f76c98e12c007, State: Initialized, Role: FOLLOWER
I20260807 06:21:46.600678 24293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260807 06:21:46.600847 24293 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:46.600924 24293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:46.601044 24293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:46.602018 24293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260807 06:21:46.602408 24293 leader_election.cc:302] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32a8073d4ddd47aea69f76c98e12c007; no voters:
I20260807 06:21:46.602815 24293 leader_election.cc:288] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:46.602895 24300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:46.602999 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:46.603160 24300 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [term 1 LEADER]: Becoming Leader. State: Replica: 32a8073d4ddd47aea69f76c98e12c007, State: Running, Role: LEADER
I20260807 06:21:46.603506 24300 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } }
I20260807 06:21:46.604236 24293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:46.604619 24300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32a8073d4ddd47aea69f76c98e12c007. Latest consensus state: current_term: 1 leader_uuid: "32a8073d4ddd47aea69f76c98e12c007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260807 06:21:46.604755 24300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:46.605213 24313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:46.605190 24301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32a8073d4ddd47aea69f76c98e12c007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a8073d4ddd47aea69f76c98e12c007" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46245 } } }
I20260807 06:21:46.605299 24301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:46.608419 24313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:46.610832 24297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:46.605721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39261 (local address 127.0.0.1:46245)
0807 06:21:46.605835 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:46.605839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:46.606227 (+ 388us) server_negotiation.cc:407] Connection header received
0807 06:21:46.606391 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:46.606394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:46.606473 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:46.606559 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:46.606939 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:46.607667 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:46.608924 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:46.609319 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:46.609383 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:46.610347 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:46.610350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:46.610353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:46.610365 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:46.610397 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:46.610439 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:46.610518 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:46.610647 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 06:21:46.610699 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 06:21:46.614491 24313 catalog_manager.cc:1347] Generated new cluster ID: 7c8b1cc7cb1b448f86e5f41c10450a21
I20260807 06:21:46.614571 24313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:46.623241 24313 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:46.624411 24313 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:46.633005 24313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32a8073d4ddd47aea69f76c98e12c007: Generated new TSK 0
I20260807 06:21:46.633744 24313 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:46.642424 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24188
2026-08-07T06:21:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:46 dist-test-slave-68xk krb5kdc[24340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:46 dist-test-slave-68xk krb5kdc[24340](info): set up 2 sockets
Aug 07 06:21:46 dist-test-slave-68xk krb5kdc[24340](info): commencing operation
krb5kdc: starting...
W20260807 06:21:47.862031 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:47 dist-test-slave-68xk krb5kdc[24340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:47.997022 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39457
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:48.114332 24357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:48.114663 24357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:48.114743 24357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:48.118769 24357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:48.118865 24357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:48.118903 24357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:48.118939 24357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:48.118973 24357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:48.124224 24357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:48.125288 24357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:48.126319 24357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:48.134807 24366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:48.134830 24363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:48.135102 24357 server_base.cc:1034] running on GCE node
W20260807 06:21:48.134804 24362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:48.135739 24357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:48.136762 24357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:48.137928 24357 hybrid_clock.cc:648] HybridClock initialized: now 1786083708137916 us; error 27 us; skew 500 ppm
Aug 07 06:21:48 dist-test-slave-68xk krb5kdc[24340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083708, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:48.140738 24357 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:48.141636 24357 webserver.cc:460] Webserver started at http://127.0.0.1:43469/ using document root <none> and password file <none>
I20260807 06:21:48.142201 24357 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:48.142303 24357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:48.142582 24357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:48.144752 24357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "d3d194ff5d774571a73fa2f946e03fd6"
format_stamp: "Formatted at 2026-08-07 06:21:48 on dist-test-slave-68xk"
server_key: "51553852c6f85285f159a31cf96f0472"
server_key_iv: "c40ae5f3df4002e02875e43387bca4f2"
server_key_version: "encryptionkey@0"
I20260807 06:21:48.145341 24357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "d3d194ff5d774571a73fa2f946e03fd6"
format_stamp: "Formatted at 2026-08-07 06:21:48 on dist-test-slave-68xk"
server_key: "51553852c6f85285f159a31cf96f0472"
server_key_iv: "c40ae5f3df4002e02875e43387bca4f2"
server_key_version: "encryptionkey@0"
I20260807 06:21:48.149159 24357 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 06:21:48.151639 24376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:48.152858 24357 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:21:48.153004 24357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "d3d194ff5d774571a73fa2f946e03fd6"
format_stamp: "Formatted at 2026-08-07 06:21:48 on dist-test-slave-68xk"
server_key: "51553852c6f85285f159a31cf96f0472"
server_key_iv: "c40ae5f3df4002e02875e43387bca4f2"
server_key_version: "encryptionkey@0"
I20260807 06:21:48.153116 24357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:48.157645 24357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:48.160625 24357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:48.160816 24357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:48.167891 24357 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39457
I20260807 06:21:48.167943 24457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39457 every 8 connection(s)
I20260807 06:21:48.168846 24357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:48.171581 24458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:48.173915 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24357
I20260807 06:21:48.174073 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:48.174355 27633 external_mini_cluster.cc:1428] Setting key 7b7f1278ecd278afdb738936d3452e58
I20260807 06:21:48.178016 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6: Bootstrap starting.
I20260807 06:21:48.180073 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:48.175782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38507 (local address 127.0.0.1:39457)
0807 06:21:48.176244 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:48.176264 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:48.176310 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:21:48.177141 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:48.177165 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:48.177537 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:48.177911 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:48.178645 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:48.178651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:48.178666 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:48.178677 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:48.178746 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:48.178774 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:48.178906 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:48.178971 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:21:48.179121 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":112,"threads_started":1}
I20260807 06:21:48.180996 24458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:48.181769 24458 log.cc:824] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:48.183252 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:48.183939 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6: No bootstrap required, opened a new log
I20260807 06:21:48.187273 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:48.185476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35437 (local address 127.0.0.1:39457)
0807 06:21:48.185616 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:48.185622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:48.185815 (+ 193us) server_negotiation.cc:407] Connection header received
0807 06:21:48.185941 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:48.185943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:48.185975 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:48.186046 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:48.186849 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:48.186852 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:48.186854 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:48.186865 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:48.186891 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:48.186902 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:48.186971 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:48.187086 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 06:21:48.187121 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:21:48.188439 24458 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } }
I20260807 06:21:48.188684 24458 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:48.188760 24458 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d194ff5d774571a73fa2f946e03fd6, State: Initialized, Role: FOLLOWER
I20260807 06:21:48.189174 24458 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } }
I20260807 06:21:48.189327 24458 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:48.189393 24458 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:48.189517 24458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:48.190740 24458 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } }
I20260807 06:21:48.191044 24458 leader_election.cc:302] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3d194ff5d774571a73fa2f946e03fd6; no voters:
I20260807 06:21:48.191324 24458 leader_election.cc:288] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:48.191432 24469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:48.191671 24469 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [term 1 LEADER]: Becoming Leader. State: Replica: d3d194ff5d774571a73fa2f946e03fd6, State: Running, Role: LEADER
I20260807 06:21:48.192030 24469 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } }
I20260807 06:21:48.192638 24458 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:48.193905 24473 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3d194ff5d774571a73fa2f946e03fd6. Latest consensus state: current_term: 1 leader_uuid: "d3d194ff5d774571a73fa2f946e03fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } } }
I20260807 06:21:48.193974 24470 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3d194ff5d774571a73fa2f946e03fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3d194ff5d774571a73fa2f946e03fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39457 } } }
I20260807 06:21:48.194090 24473 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:48.194098 24470 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:48.194603 24485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:48.197499 24485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:48.203148 24485 catalog_manager.cc:1347] Generated new cluster ID: 32789b7266bf4cf5ba950caab1757dda
I20260807 06:21:48.203284 24485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:48.217620 24485 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:48.217965 24485 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:48.230525 24485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3d194ff5d774571a73fa2f946e03fd6: Generated new TSK 0
I20260807 06:21:48.231285 24485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:48.241485 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24357
2026-08-07T06:21:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:48 dist-test-slave-68xk krb5kdc[24503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:48 dist-test-slave-68xk krb5kdc[24503](info): set up 2 sockets
Aug 07 06:21:48 dist-test-slave-68xk krb5kdc[24503](info): commencing operation
krb5kdc: starting...
W20260807 06:21:49.491627 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:49.626178 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33813
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:49.738015 24525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:49.738329 24525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:49.738451 24525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:49.742465 24525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:49.742544 24525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:49.742583 24525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:49.742616 24525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:49.742645 24525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:49.748044 24525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:49.749112 24525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:49.750164 24525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:49.758575 24533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:49.758719 24532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:49.758800 24525 server_base.cc:1034] running on GCE node
W20260807 06:21:49.758731 24535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:49.759460 24525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:49.760596 24525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:49.761791 24525 hybrid_clock.cc:648] HybridClock initialized: now 1786083709761762 us; error 41 us; skew 500 ppm
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083709, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:49.764671 24525 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:49.765542 24525 webserver.cc:460] Webserver started at http://127.0.0.1:42917/ using document root <none> and password file <none>
I20260807 06:21:49.766093 24525 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:49.766152 24525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:49.766322 24525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:49.768460 24525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "5ba5588d8a164f679386cacd10992823"
format_stamp: "Formatted at 2026-08-07 06:21:49 on dist-test-slave-68xk"
server_key: "90e84b059d5c4aa6cb7538ce2fc0e67c"
server_key_iv: "6e2e5db1052f027f7b6546b8e873079b"
server_key_version: "encryptionkey@0"
I20260807 06:21:49.768997 24525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "5ba5588d8a164f679386cacd10992823"
format_stamp: "Formatted at 2026-08-07 06:21:49 on dist-test-slave-68xk"
server_key: "90e84b059d5c4aa6cb7538ce2fc0e67c"
server_key_iv: "6e2e5db1052f027f7b6546b8e873079b"
server_key_version: "encryptionkey@0"
I20260807 06:21:49.772819 24525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:49.775247 24548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:49.776558 24525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:49.776739 24525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "5ba5588d8a164f679386cacd10992823"
format_stamp: "Formatted at 2026-08-07 06:21:49 on dist-test-slave-68xk"
server_key: "90e84b059d5c4aa6cb7538ce2fc0e67c"
server_key_iv: "6e2e5db1052f027f7b6546b8e873079b"
server_key_version: "encryptionkey@0"
I20260807 06:21:49.776861 24525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:49.791966 24525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:49.795251 24525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:49.795454 24525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:49.802775 24525 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33813
I20260807 06:21:49.802804 24624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33813 every 8 connection(s)
I20260807 06:21:49.803699 24525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:49.806766 24626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:49.812600 24626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823: Bootstrap starting.
I20260807 06:21:49.812887 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24525
I20260807 06:21:49.813047 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:49.813366 27633 external_mini_cluster.cc:1428] Setting key bac2612fb776608ce15f12e405eacc56
I20260807 06:21:49.816354 24626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:49.817373 24626 log.cc:824] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:49.819813 24626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823: No bootstrap required, opened a new log
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083709, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:21:49.823837 24626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } }
I20260807 06:21:49.824077 24626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:49.824203 24626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba5588d8a164f679386cacd10992823, State: Initialized, Role: FOLLOWER
I20260807 06:21:49.824715 24626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } }
I20260807 06:21:49.824908 24626 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:49.824988 24626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:49.825119 24626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:49.826337 24626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } }
I20260807 06:21:49.826743 24626 leader_election.cc:302] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ba5588d8a164f679386cacd10992823; no voters:
I20260807 06:21:49.827104 24626 leader_election.cc:288] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:49.827175 24632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:49.827409 24632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [term 1 LEADER]: Becoming Leader. State: Replica: 5ba5588d8a164f679386cacd10992823, State: Running, Role: LEADER
I20260807 06:21:49.827754 24632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } }
I20260807 06:21:49.828433 24626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:49.829423 24633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ba5588d8a164f679386cacd10992823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } } }
I20260807 06:21:49.829582 24633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:49.829998 24645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:49.830626 24635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ba5588d8a164f679386cacd10992823. Latest consensus state: current_term: 1 leader_uuid: "5ba5588d8a164f679386cacd10992823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ba5588d8a164f679386cacd10992823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33813 } } }
I20260807 06:21:49.830681 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:49.814914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:56371 (local address 127.0.0.1:33813)
0807 06:21:49.815568 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:49.815589 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:49.815635 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:21:49.816612 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:49.816640 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:49.817121 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:49.817526 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:49.818505 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:49.819930 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:49.820789 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:49.821513 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:49.821682 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:49.824279 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:49.824287 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:49.824304 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:49.824334 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:49.826476 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:49.827013 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:49.827019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:49.827025 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:49.827151 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:49.827614 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:49.827618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:49.827623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:49.828147 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:49.828307 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:49.828839 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 06:21:49.829101 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":125,"threads_started":1}
I20260807 06:21:49.830790 24635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:49.833166 24645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:49.834054 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:49.839524 24645 catalog_manager.cc:1347] Generated new cluster ID: ebd489adafd74b20a70208ebd2d8cb9a
I20260807 06:21:49.839628 24645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:49.845984 24630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:49.836341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:57325 (local address 127.0.0.1:33813)
0807 06:21:49.836443 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:49.836447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:49.836971 (+ 524us) server_negotiation.cc:407] Connection header received
0807 06:21:49.837074 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:49.837077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:49.837131 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:49.837216 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:49.838035 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:49.838946 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:49.839967 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:49.840337 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:49.840454 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:49.842068 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:49.842074 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:49.842078 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:49.842106 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:49.843797 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:49.844560 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:49.844564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:49.844566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:49.844654 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:49.845027 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:49.845031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:49.845033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:49.845248 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:49.845395 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:49.845720 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 06:21:49.845826 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":40}
I20260807 06:21:49.847128 24645 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:49.848269 24645 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:49.853122 24645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ba5588d8a164f679386cacd10992823: Generated new TSK 0
I20260807 06:21:49.853875 24645 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:49.860940 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24525
W20260807 06:21:49.877116 24498 connection.cc:535] client connection to 127.0.0.1:33813 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33813): Connection reset by peer (error 104)
2026-08-07T06:21:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24676](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24676](info): set up 2 sockets
Aug 07 06:21:49 dist-test-slave-68xk krb5kdc[24676](info): commencing operation
krb5kdc: starting...
W20260807 06:21:51.125353 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:51 dist-test-slave-68xk krb5kdc[24676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:51.254149 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:51.366153 24693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:51.366484 24693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:51.366565 24693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:51.370535 24693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:51.370623 24693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:51.370663 24693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:51.370702 24693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:51.370744 24693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:51.375928 24693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:51.377008 24693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:51.378053 24693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:51.386521 24708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:51.386469 24705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:51.386487 24706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:51.386677 24693 server_base.cc:1034] running on GCE node
I20260807 06:21:51.387339 24693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:51.388430 24693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:51.389595 24693 hybrid_clock.cc:648] HybridClock initialized: now 1786083711389572 us; error 34 us; skew 500 ppm
Aug 07 06:21:51 dist-test-slave-68xk krb5kdc[24676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083711, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:51.392491 24693 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:51.393383 24693 webserver.cc:460] Webserver started at http://127.0.0.1:42905/ using document root <none> and password file <none>
I20260807 06:21:51.393920 24693 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:51.393980 24693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:51.394146 24693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:51.396210 24693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "883a504800d7499babc9870a4e9064f8"
format_stamp: "Formatted at 2026-08-07 06:21:51 on dist-test-slave-68xk"
server_key: "f23441a2e80f07ea2428e1a596036d3c"
server_key_iv: "42c12299daf4c1e23e79acdf2ccfbbc2"
server_key_version: "encryptionkey@0"
I20260807 06:21:51.396723 24693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "883a504800d7499babc9870a4e9064f8"
format_stamp: "Formatted at 2026-08-07 06:21:51 on dist-test-slave-68xk"
server_key: "f23441a2e80f07ea2428e1a596036d3c"
server_key_iv: "42c12299daf4c1e23e79acdf2ccfbbc2"
server_key_version: "encryptionkey@0"
I20260807 06:21:51.400475 24693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:21:51.402895 24717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:51.404114 24693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:51.404263 24693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "883a504800d7499babc9870a4e9064f8"
format_stamp: "Formatted at 2026-08-07 06:21:51 on dist-test-slave-68xk"
server_key: "f23441a2e80f07ea2428e1a596036d3c"
server_key_iv: "42c12299daf4c1e23e79acdf2ccfbbc2"
server_key_version: "encryptionkey@0"
I20260807 06:21:51.404373 24693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:51.423702 24693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:51.427006 24693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:51.427210 24693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:51.434377 24693 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43913
I20260807 06:21:51.434406 24791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43913 every 8 connection(s)
I20260807 06:21:51.435323 24693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:51.437997 24794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:51.440482 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24693
I20260807 06:21:51.440626 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:51.440896 27633 external_mini_cluster.cc:1428] Setting key d81e6b88c2252dc00e02cb8fbc294716
I20260807 06:21:51.444320 24794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8: Bootstrap starting.
I20260807 06:21:51.446967 24794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:51.447858 24794 log.cc:824] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:51.450170 24794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8: No bootstrap required, opened a new log
I20260807 06:21:51.451047 24798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:51.442274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:36627 (local address 127.0.0.1:43913)
0807 06:21:51.442730 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:51.442758 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:51.442801 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:21:51.443627 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:51.443650 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:51.444077 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:51.444435 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:51.444848 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:51.446329 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:51.447262 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:51.447981 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:51.448142 (+ 161us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:51.449092 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:51.449098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:51.449113 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:51.449601 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:51.449667 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:51.449697 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:51.449851 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:51.449972 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 06:21:51.450097 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":159,"threads_started":1}
I20260807 06:21:51.454016 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:51.454406 24794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260807 06:21:51.454710 24794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:51.454803 24794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 883a504800d7499babc9870a4e9064f8, State: Initialized, Role: FOLLOWER
I20260807 06:21:51.455282 24794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260807 06:21:51.455473 24794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:51.455617 24794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:51.455749 24794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:51.456832 24794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260807 06:21:51.457209 24794 leader_election.cc:302] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 883a504800d7499babc9870a4e9064f8; no voters:
I20260807 06:21:51.457558 24794 leader_election.cc:288] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:51.457623 24809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:51.457847 24809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [term 1 LEADER]: Becoming Leader. State: Replica: 883a504800d7499babc9870a4e9064f8, State: Running, Role: LEADER
I20260807 06:21:51.458206 24809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } }
I20260807 06:21:51.458884 24794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:51.459867 24812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 883a504800d7499babc9870a4e9064f8. Latest consensus state: current_term: 1 leader_uuid: "883a504800d7499babc9870a4e9064f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } } }
I20260807 06:21:51.460004 24812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:51.460222 24812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "883a504800d7499babc9870a4e9064f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "883a504800d7499babc9870a4e9064f8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43913 } } }
I20260807 06:21:51.460709 24812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:51.461562 24822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:51.461750 24798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:51.456505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:42139 (local address 127.0.0.1:43913)
0807 06:21:51.456643 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:51.456648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:51.456865 (+ 217us) server_negotiation.cc:407] Connection header received
0807 06:21:51.457043 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:51.457046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:51.457088 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:51.457171 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:51.457482 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:51.458271 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:51.459406 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:51.459772 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:51.460335 (+ 563us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:51.460878 (+ 543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:51.460881 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:51.460883 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:51.460894 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:51.460917 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:51.460927 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:51.461035 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:51.461484 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 06:21:51.461523 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:21:51.464601 24822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:51.469870 24822 catalog_manager.cc:1347] Generated new cluster ID: 08d56d2938b5481dbcc19ad028c47c0f
I20260807 06:21:51.469986 24822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:51.476804 24822 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:51.477645 24822 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:51.486326 24822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 883a504800d7499babc9870a4e9064f8: Generated new TSK 0
I20260807 06:21:51.486994 24822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:51.491489 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24693
W20260807 06:21:51.508934 24673 connection.cc:535] client connection to 127.0.0.1:43913 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43913): Connection reset by peer (error 104)
2026-08-07T06:21:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:51 dist-test-slave-68xk krb5kdc[24839](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:51 dist-test-slave-68xk krb5kdc[24839](info): set up 2 sockets
Aug 07 06:21:51 dist-test-slave-68xk krb5kdc[24839](info): commencing operation
krb5kdc: starting...
W20260807 06:21:52.741120 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:52 dist-test-slave-68xk krb5kdc[24839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:52.872994 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44407
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:52.986888 24858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:52.987161 24858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:52.987231 24858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:52.991158 24858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:52.991242 24858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:52.991282 24858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:52.991336 24858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:52.991376 24858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:52.996462 24858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:52.997478 24858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:52.998524 24858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:53.007671 24865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:53.007674 24867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:53.007862 24858 server_base.cc:1034] running on GCE node
W20260807 06:21:53.008071 24869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:53.008718 24858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:53.010133 24858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:53.011350 24858 hybrid_clock.cc:648] HybridClock initialized: now 1786083713011327 us; error 38 us; skew 500 ppm
Aug 07 06:21:53 dist-test-slave-68xk krb5kdc[24839](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083713, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:53.014932 24858 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:53.015899 24858 webserver.cc:460] Webserver started at http://127.0.0.1:42129/ using document root <none> and password file <none>
I20260807 06:21:53.016480 24858 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:53.016544 24858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:53.016791 24858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:53.018967 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "760105629c774ef9b79d599f06c1c543"
format_stamp: "Formatted at 2026-08-07 06:21:53 on dist-test-slave-68xk"
server_key: "0fed1b7dc97b09cd9e7c120de5a4742a"
server_key_iv: "823e128a1ebfc24fb33afd9ec2afdfb8"
server_key_version: "encryptionkey@0"
I20260807 06:21:53.019543 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "760105629c774ef9b79d599f06c1c543"
format_stamp: "Formatted at 2026-08-07 06:21:53 on dist-test-slave-68xk"
server_key: "0fed1b7dc97b09cd9e7c120de5a4742a"
server_key_iv: "823e128a1ebfc24fb33afd9ec2afdfb8"
server_key_version: "encryptionkey@0"
I20260807 06:21:53.023680 24858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:21:53.026080 24878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:53.027382 24858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:21:53.027525 24858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "760105629c774ef9b79d599f06c1c543"
format_stamp: "Formatted at 2026-08-07 06:21:53 on dist-test-slave-68xk"
server_key: "0fed1b7dc97b09cd9e7c120de5a4742a"
server_key_iv: "823e128a1ebfc24fb33afd9ec2afdfb8"
server_key_version: "encryptionkey@0"
I20260807 06:21:53.027637 24858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:53.032289 24858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:53.035084 24858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:53.035270 24858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:53.042238 24858 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44407
I20260807 06:21:53.042277 24957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44407 every 8 connection(s)
I20260807 06:21:53.043206 24858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:53.045820 24958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:53.049882 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 24858
I20260807 06:21:53.050022 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:53.050316 27633 external_mini_cluster.cc:1428] Setting key 25c73157e35123e7b4563827cf8e5e00
I20260807 06:21:53.051995 24958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543: Bootstrap starting.
I20260807 06:21:53.054354 24958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:53.055171 24958 log.cc:824] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:53.056083 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:53.052074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:56031 (local address 127.0.0.1:44407)
0807 06:21:53.052525 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:53.052539 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:53.052574 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:21:53.053194 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:53.053209 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:53.053490 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:53.053830 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:53.054693 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:53.054698 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:53.054719 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:53.054730 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:53.054782 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:53.054801 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:53.054920 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:53.055037 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 06:21:53.055198 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":138,"threads_started":1}
I20260807 06:21:53.057279 24958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543: No bootstrap required, opened a new log
I20260807 06:21:53.058977 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:53.061298 24958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } }
I20260807 06:21:53.061587 24958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:53.061656 24958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 760105629c774ef9b79d599f06c1c543, State: Initialized, Role: FOLLOWER
I20260807 06:21:53.062134 24958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } }
I20260807 06:21:53.062330 24958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:53.062449 24958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:53.062562 24958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:53.062997 24964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:53.061084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:43861 (local address 127.0.0.1:44407)
0807 06:21:53.061199 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:53.061203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:53.061468 (+ 265us) server_negotiation.cc:407] Connection header received
0807 06:21:53.061607 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:53.061609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:53.061647 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:53.061753 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:53.062552 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:53.062555 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:53.062558 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:53.062569 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:53.062596 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:53.062613 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:53.062706 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:53.062843 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 06:21:53.062884 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 06:21:53.063706 24958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } }
I20260807 06:21:53.064060 24958 leader_election.cc:302] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 760105629c774ef9b79d599f06c1c543; no voters:
I20260807 06:21:53.064394 24958 leader_election.cc:288] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:53.064500 24977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:53.064772 24977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [term 1 LEADER]: Becoming Leader. State: Replica: 760105629c774ef9b79d599f06c1c543, State: Running, Role: LEADER
I20260807 06:21:53.065126 24977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } }
I20260807 06:21:53.065611 24958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:53.066885 24979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "760105629c774ef9b79d599f06c1c543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } } }
I20260807 06:21:53.067035 24979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:53.066893 24981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 760105629c774ef9b79d599f06c1c543. Latest consensus state: current_term: 1 leader_uuid: "760105629c774ef9b79d599f06c1c543" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "760105629c774ef9b79d599f06c1c543" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44407 } } }
I20260807 06:21:53.067128 24981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:53.067538 24996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:53.070770 24996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:53.075747 24996 catalog_manager.cc:1347] Generated new cluster ID: 97565e6450894492a978becbfadf5f17
I20260807 06:21:53.075812 24996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:53.099720 24996 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:53.100112 24996 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:53.105186 24996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 760105629c774ef9b79d599f06c1c543: Generated new TSK 0
I20260807 06:21:53.105841 24996 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:53.111486 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 24858
2026-08-07T06:21:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:53 dist-test-slave-68xk krb5kdc[25013](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:53 dist-test-slave-68xk krb5kdc[25013](info): set up 2 sockets
Aug 07 06:21:53 dist-test-slave-68xk krb5kdc[25013](info): commencing operation
krb5kdc: starting...
W20260807 06:21:54.326179 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:54.453385 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:54.563561 25034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:54.563803 25034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:54.563843 25034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:54.567674 25034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:54.567725 25034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:54.567745 25034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:54.567761 25034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:54.567776 25034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:54.572773 25034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36935
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:54.573719 25034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:54.574695 25034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:54.583915 25040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:54.583915 25046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:54.583951 25041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:54.584214 25034 server_base.cc:1034] running on GCE node
I20260807 06:21:54.584847 25034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:54.586068 25034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:54.587275 25034 hybrid_clock.cc:648] HybridClock initialized: now 1786083714587258 us; error 31 us; skew 500 ppm
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25013](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083714, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:54.593680 25034 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:54.594748 25034 webserver.cc:460] Webserver started at http://127.0.0.1:36461/ using document root <none> and password file <none>
I20260807 06:21:54.595316 25034 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:54.595382 25034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:54.595549 25034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:54.597600 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "b7e4a95f7ca74d31811df75b60fc1335"
format_stamp: "Formatted at 2026-08-07 06:21:54 on dist-test-slave-68xk"
server_key: "06d8c25526979cea9bd12c9ac96d4467"
server_key_iv: "7d8141a56dd6464d7b9226f5320a0fa9"
server_key_version: "encryptionkey@0"
I20260807 06:21:54.598136 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "b7e4a95f7ca74d31811df75b60fc1335"
format_stamp: "Formatted at 2026-08-07 06:21:54 on dist-test-slave-68xk"
server_key: "06d8c25526979cea9bd12c9ac96d4467"
server_key_iv: "7d8141a56dd6464d7b9226f5320a0fa9"
server_key_version: "encryptionkey@0"
I20260807 06:21:54.601929 25034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:21:54.604440 25054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:54.605707 25034 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 06:21:54.605818 25034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "b7e4a95f7ca74d31811df75b60fc1335"
format_stamp: "Formatted at 2026-08-07 06:21:54 on dist-test-slave-68xk"
server_key: "06d8c25526979cea9bd12c9ac96d4467"
server_key_iv: "7d8141a56dd6464d7b9226f5320a0fa9"
server_key_version: "encryptionkey@0"
I20260807 06:21:54.605903 25034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:54.619962 25034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:54.622810 25034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:54.622974 25034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:54.629974 25034 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36935
I20260807 06:21:54.630002 25126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36935 every 8 connection(s)
I20260807 06:21:54.630976 25034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:54.633687 25127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:54.639401 25127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335: Bootstrap starting.
I20260807 06:21:54.639500 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25034
I20260807 06:21:54.639699 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:54.639991 27633 external_mini_cluster.cc:1428] Setting key 2cf2e87f0cbdb6c0b1fb06b0e3476e4d
I20260807 06:21:54.642050 25127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:54.642879 25127 log.cc:824] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:54.644754 25127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335: No bootstrap required, opened a new log
I20260807 06:21:54.648275 25127 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260807 06:21:54.648506 25127 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:54.648586 25127 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7e4a95f7ca74d31811df75b60fc1335, State: Initialized, Role: FOLLOWER
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25013](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 06:21:54.649050 25127 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260807 06:21:54.649246 25127 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:54.649325 25127 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:54.649430 25127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:54.650547 25127 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260807 06:21:54.650875 25127 leader_election.cc:302] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7e4a95f7ca74d31811df75b60fc1335; no voters:
I20260807 06:21:54.651175 25127 leader_election.cc:288] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:54.651286 25139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:54.651516 25139 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [term 1 LEADER]: Becoming Leader. State: Replica: b7e4a95f7ca74d31811df75b60fc1335, State: Running, Role: LEADER
I20260807 06:21:54.651891 25139 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } }
I20260807 06:21:54.652558 25127 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:54.654134 25142 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7e4a95f7ca74d31811df75b60fc1335. Latest consensus state: current_term: 1 leader_uuid: "b7e4a95f7ca74d31811df75b60fc1335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } } }
I20260807 06:21:54.654259 25142 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:54.655432 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:54.641318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:51021 (local address 127.0.0.1:36935)
0807 06:21:54.641744 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:54.641758 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:54.641795 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:21:54.642522 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:54.642542 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:54.642900 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:54.643263 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:54.644096 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:54.645123 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:54.645994 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:54.646543 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:54.646705 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:54.649593 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:54.649598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:54.649611 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:54.649638 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:54.651657 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:54.652263 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:54.652269 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:54.652275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:54.652413 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:54.652831 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:54.652834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:54.652836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:54.653352 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:54.653580 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:54.654215 (+ 635us) server_negotiation.cc:299] Negotiation successful
0807 06:21:54.654483 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":125,"threads_started":1}
I20260807 06:21:54.657341 25150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:54.657218 25140 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7e4a95f7ca74d31811df75b60fc1335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7e4a95f7ca74d31811df75b60fc1335" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36935 } } }
I20260807 06:21:54.657517 25140 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:54.659207 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:54.660696 25150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:54.666652 25150 catalog_manager.cc:1347] Generated new cluster ID: ac711f3386954f24a8283426040999a1
I20260807 06:21:54.666777 25150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:54.670630 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:54.661528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:56589 (local address 127.0.0.1:36935)
0807 06:21:54.661641 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:54.661646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:54.661899 (+ 253us) server_negotiation.cc:407] Connection header received
0807 06:21:54.662022 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:54.662025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:54.662073 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:54.662138 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:54.663035 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:54.663825 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:54.664835 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:54.665152 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:54.665263 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:54.667074 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:54.667078 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:54.667081 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:54.667113 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:54.668763 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:54.669299 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:54.669302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:54.669304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:54.669383 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:54.669739 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:54.669742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:54.669744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:54.669923 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:54.670061 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:54.670359 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 06:21:54.670485 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:21:54.680361 25150 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:54.681519 25150 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:54.686846 25150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7e4a95f7ca74d31811df75b60fc1335: Generated new TSK 0
I20260807 06:21:54.687580 25150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:54.697986 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25034
W20260807 06:21:54.714825 25011 connection.cc:535] client connection to 127.0.0.1:36935 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36935): Connection reset by peer (error 104)
2026-08-07T06:21:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1591 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25176](info): set up 2 sockets
Aug 07 06:21:54 dist-test-slave-68xk krb5kdc[25176](info): commencing operation
krb5kdc: starting...
W20260807 06:21:55.962342 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:56 dist-test-slave-68xk krb5kdc[25176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:56.093544 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34295
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:56.207226 25193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:56.207525 25193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:56.207568 25193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:56.211642 25193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:56.211705 25193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:56.211725 25193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:56.211748 25193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:56.211790 25193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:56.217165 25193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34295
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:56.218237 25193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:56.219329 25193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:21:56.228207 25193 server_base.cc:1034] running on GCE node
W20260807 06:21:56.228192 25204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:56.228178 25206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:56.228384 25203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:56.229019 25193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:56.230095 25193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:56.231295 25193 hybrid_clock.cc:648] HybridClock initialized: now 1786083716231281 us; error 27 us; skew 500 ppm
Aug 07 06:21:56 dist-test-slave-68xk krb5kdc[25176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083716, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:56.234118 25193 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:56.235034 25193 webserver.cc:460] Webserver started at http://127.0.0.1:34857/ using document root <none> and password file <none>
I20260807 06:21:56.235571 25193 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:56.235631 25193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:56.235793 25193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:56.237764 25193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "3c85fb0df9c84fec9514812a0b64e121"
format_stamp: "Formatted at 2026-08-07 06:21:56 on dist-test-slave-68xk"
server_key: "acddd4da720648742f99bd4da6b8961e"
server_key_iv: "efd3e2101e0e221c54af4b28ff9fc48e"
server_key_version: "encryptionkey@0"
I20260807 06:21:56.238291 25193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "3c85fb0df9c84fec9514812a0b64e121"
format_stamp: "Formatted at 2026-08-07 06:21:56 on dist-test-slave-68xk"
server_key: "acddd4da720648742f99bd4da6b8961e"
server_key_iv: "efd3e2101e0e221c54af4b28ff9fc48e"
server_key_version: "encryptionkey@0"
I20260807 06:21:56.241973 25193 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:21:56.244537 25215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:56.245918 25193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:21:56.246070 25193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "3c85fb0df9c84fec9514812a0b64e121"
format_stamp: "Formatted at 2026-08-07 06:21:56 on dist-test-slave-68xk"
server_key: "acddd4da720648742f99bd4da6b8961e"
server_key_iv: "efd3e2101e0e221c54af4b28ff9fc48e"
server_key_version: "encryptionkey@0"
I20260807 06:21:56.246191 25193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:56.284235 25193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:56.287595 25193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:56.287835 25193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:56.295789 25193 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34295
I20260807 06:21:56.295822 25295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34295 every 8 connection(s)
I20260807 06:21:56.296862 25193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:56.300084 25296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:56.300411 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25193
I20260807 06:21:56.300586 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:56.300920 27633 external_mini_cluster.cc:1428] Setting key 86f7fef0582c625e05b397678c92bc34
I20260807 06:21:56.307425 25296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121: Bootstrap starting.
I20260807 06:21:56.309829 25296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:56.310726 25296 log.cc:824] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:56.311040 25304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:56.302493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:47267 (local address 127.0.0.1:34295)
0807 06:21:56.303002 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:56.303019 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:56.303060 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:21:56.303818 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:56.303838 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:56.304214 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:56.304587 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:56.305057 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:56.306148 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:56.307238 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:56.307811 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:56.307995 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:56.309055 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:56.309061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:56.309074 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:56.309493 (+ 419us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:56.309557 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:56.309582 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:56.309747 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:56.309947 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 06:21:56.310109 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":149,"threads_started":1}
I20260807 06:21:56.312971 25296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121: No bootstrap required, opened a new log
I20260807 06:21:56.314225 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:56.318068 25296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260807 06:21:56.318321 25296 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:56.318383 25296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c85fb0df9c84fec9514812a0b64e121, State: Initialized, Role: FOLLOWER
I20260807 06:21:56.318946 25296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260807 06:21:56.319141 25296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:56.319202 25296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:56.319309 25296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:56.320642 25296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260807 06:21:56.321100 25296 leader_election.cc:302] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c85fb0df9c84fec9514812a0b64e121; no voters:
I20260807 06:21:56.321600 25296 leader_election.cc:288] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:56.321655 25304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:56.316827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:41633 (local address 127.0.0.1:34295)
0807 06:21:56.316963 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:56.316967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:56.317154 (+ 187us) server_negotiation.cc:407] Connection header received
0807 06:21:56.317297 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:56.317300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:56.317343 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:56.317417 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:56.317767 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:56.318406 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:56.319663 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:56.319915 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:56.320008 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:56.321038 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:56.321042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:56.321045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:56.321060 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:56.321090 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:56.321104 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:56.321219 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:56.321450 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 06:21:56.321495 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:21:56.321698 25315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:56.322052 25315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [term 1 LEADER]: Becoming Leader. State: Replica: 3c85fb0df9c84fec9514812a0b64e121, State: Running, Role: LEADER
I20260807 06:21:56.322386 25315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } }
I20260807 06:21:56.323167 25296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:56.323721 25316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c85fb0df9c84fec9514812a0b64e121. Latest consensus state: current_term: 1 leader_uuid: "3c85fb0df9c84fec9514812a0b64e121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } } }
I20260807 06:21:56.323858 25316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:56.324247 25318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c85fb0df9c84fec9514812a0b64e121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c85fb0df9c84fec9514812a0b64e121" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34295 } } }
I20260807 06:21:56.324396 25318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:56.325624 25323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:56.328666 25323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:56.335153 25323 catalog_manager.cc:1347] Generated new cluster ID: b3239f851831436c962776f6d19d89cc
I20260807 06:21:56.335234 25323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:56.352804 25323 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:56.353844 25323 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:56.374362 25323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c85fb0df9c84fec9514812a0b64e121: Generated new TSK 0
I20260807 06:21:56.375125 25323 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:56.380514 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25193
W20260807 06:21:56.394374 25172 connection.cc:535] client connection to 127.0.0.1:34295 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34295): Connection reset by peer (error 104)
2026-08-07T06:21:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1679 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:56 dist-test-slave-68xk krb5kdc[25347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:56 dist-test-slave-68xk krb5kdc[25347](info): set up 2 sockets
Aug 07 06:21:56 dist-test-slave-68xk krb5kdc[25347](info): commencing operation
krb5kdc: starting...
W20260807 06:21:57.671218 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:57 dist-test-slave-68xk krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 06:21:57.805605 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35863
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:57.920750 25367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:57.921072 25367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:57.921147 25367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:57.925200 25367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:57.925302 25367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:57.925343 25367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:57.925398 25367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:57.925436 25367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:57.930749 25367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35863
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:57.931876 25367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:57.932934 25367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:57.941817 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:57.941937 25375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:57.941848 25373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:57.942315 25367 server_base.cc:1034] running on GCE node
I20260807 06:21:57.943001 25367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:57.944470 25367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:57.945693 25367 hybrid_clock.cc:648] HybridClock initialized: now 1786083717945675 us; error 33 us; skew 500 ppm
Aug 07 06:21:57 dist-test-slave-68xk krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083717, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:57.948628 25367 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 06:21:57.949558 25367 webserver.cc:460] Webserver started at http://127.0.0.1:38069/ using document root <none> and password file <none>
I20260807 06:21:57.950121 25367 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:57.950264 25367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:57.950567 25367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:57.952600 25367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "48da3961ed3346a0afc9ebc7e7a63acb"
format_stamp: "Formatted at 2026-08-07 06:21:57 on dist-test-slave-68xk"
server_key: "a1976085ebbcd3a1b8d13c044da8ea84"
server_key_iv: "71d6f28bd3272bc973fdebb7921b4a64"
server_key_version: "encryptionkey@0"
I20260807 06:21:57.953186 25367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "48da3961ed3346a0afc9ebc7e7a63acb"
format_stamp: "Formatted at 2026-08-07 06:21:57 on dist-test-slave-68xk"
server_key: "a1976085ebbcd3a1b8d13c044da8ea84"
server_key_iv: "71d6f28bd3272bc973fdebb7921b4a64"
server_key_version: "encryptionkey@0"
I20260807 06:21:57.956982 25367 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 06:21:57.959489 25385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:57.960723 25367 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 06:21:57.960877 25367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "48da3961ed3346a0afc9ebc7e7a63acb"
format_stamp: "Formatted at 2026-08-07 06:21:57 on dist-test-slave-68xk"
server_key: "a1976085ebbcd3a1b8d13c044da8ea84"
server_key_iv: "71d6f28bd3272bc973fdebb7921b4a64"
server_key_version: "encryptionkey@0"
I20260807 06:21:57.960989 25367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:57.965732 25367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:57.968683 25367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:57.968878 25367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:57.975875 25367 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35863
I20260807 06:21:57.975885 25466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35863 every 8 connection(s)
I20260807 06:21:57.976796 25367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:57.979619 25467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:57.982132 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25367
I20260807 06:21:57.982391 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:57.982734 27633 external_mini_cluster.cc:1428] Setting key 8bbd4aafc196f98b92fb162e6782c0ae
I20260807 06:21:57.985754 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb: Bootstrap starting.
I20260807 06:21:57.988461 25467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:57.988591 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:57.984300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:51745 (local address 127.0.0.1:35863)
0807 06:21:57.984768 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:57.984789 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:57.984832 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:21:57.985646 (+ 814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:57.985670 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:57.986031 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:57.986389 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:57.987230 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:57.987236 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:57.987251 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:57.987263 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:57.987331 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:57.987358 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:57.987487 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:57.987560 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 06:21:57.987711 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":135,"threads_started":1}
I20260807 06:21:57.989279 25467 log.cc:824] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:57.991271 25467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb: No bootstrap required, opened a new log
I20260807 06:21:57.991564 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:57.995688 25472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:57.993825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:49095 (local address 127.0.0.1:35863)
0807 06:21:57.993959 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:57.993964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:57.994271 (+ 307us) server_negotiation.cc:407] Connection header received
0807 06:21:57.994340 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:57.994342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:57.994374 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:57.994530 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:57.995261 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:57.995264 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:57.995266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:21:57.995278 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:57.995304 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:21:57.995315 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:57.995392 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:57.995492 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 06:21:57.995526 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:21:57.995473 25467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } }
I20260807 06:21:57.995813 25467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:57.995884 25467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48da3961ed3346a0afc9ebc7e7a63acb, State: Initialized, Role: FOLLOWER
I20260807 06:21:57.996336 25467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } }
I20260807 06:21:57.996503 25467 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:57.996578 25467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:57.996707 25467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:57.997628 25467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } }
I20260807 06:21:57.997936 25467 leader_election.cc:302] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48da3961ed3346a0afc9ebc7e7a63acb; no voters:
I20260807 06:21:57.998190 25467 leader_election.cc:288] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:57.998318 25481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:57.998590 25481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [term 1 LEADER]: Becoming Leader. State: Replica: 48da3961ed3346a0afc9ebc7e7a63acb, State: Running, Role: LEADER
I20260807 06:21:57.998907 25481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } }
I20260807 06:21:57.999451 25467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:58.000648 25486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } } }
I20260807 06:21:58.000803 25486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:58.000648 25487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48da3961ed3346a0afc9ebc7e7a63acb. Latest consensus state: current_term: 1 leader_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48da3961ed3346a0afc9ebc7e7a63acb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35863 } } }
I20260807 06:21:58.001099 25487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:58.001217 25497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:58.004014 25497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:58.009196 25497 catalog_manager.cc:1347] Generated new cluster ID: d01c14af821d4efd9dc49ec2f23df253
I20260807 06:21:58.009263 25497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:58.018468 25497 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:58.018774 25497 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:58.025815 25497 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48da3961ed3346a0afc9ebc7e7a63acb: Generated new TSK 0
I20260807 06:21:58.026526 25497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:58.034808 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25367
2026-08-07T06:21:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:58 dist-test-slave-68xk krb5kdc[25517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:58 dist-test-slave-68xk krb5kdc[25517](info): set up 2 sockets
Aug 07 06:21:58 dist-test-slave-68xk krb5kdc[25517](info): commencing operation
krb5kdc: starting...
W20260807 06:21:59.287678 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:21:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:21:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:21:59.418367 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:33515
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:33515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:21:59.530375 25531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:21:59.530643 25531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:21:59.530684 25531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:21:59.534531 25531 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:21:59.534575 25531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:21:59.534595 25531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:21:59.534610 25531 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:21:59.534626 25531 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:21:59.539669 25531 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:33515
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:33515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:21:59.540613 25531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:21:59.541549 25531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:21:59.550155 25537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:59.550184 25540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:21:59.550268 25538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:21:59.550479 25531 server_base.cc:1034] running on GCE node
I20260807 06:21:59.551108 25531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:21:59.552202 25531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:21:59.553417 25531 hybrid_clock.cc:648] HybridClock initialized: now 1786083719553382 us; error 51 us; skew 500 ppm
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:21:59.556160 25531 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:21:59.557106 25531 webserver.cc:460] Webserver started at http://127.26.252.126:37369/ using document root <none> and password file <none>
I20260807 06:21:59.557672 25531 fs_manager.cc:359] Metadata directory not provided
I20260807 06:21:59.557767 25531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:21:59.558004 25531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:21:59.560096 25531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "5ca6922f094a4952a437dd02af900dc8"
format_stamp: "Formatted at 2026-08-07 06:21:59 on dist-test-slave-68xk"
server_key: "a3a1d05125c73c9b07b90ecd0c10f2b8"
server_key_iv: "7ad4c30cd95c7668cd01bdb9757ef497"
server_key_version: "encryptionkey@0"
I20260807 06:21:59.560678 25531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "5ca6922f094a4952a437dd02af900dc8"
format_stamp: "Formatted at 2026-08-07 06:21:59 on dist-test-slave-68xk"
server_key: "a3a1d05125c73c9b07b90ecd0c10f2b8"
server_key_iv: "7ad4c30cd95c7668cd01bdb9757ef497"
server_key_version: "encryptionkey@0"
I20260807 06:21:59.564499 25531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260807 06:21:59.567108 25550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:21:59.568411 25531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:21:59.568567 25531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "5ca6922f094a4952a437dd02af900dc8"
format_stamp: "Formatted at 2026-08-07 06:21:59 on dist-test-slave-68xk"
server_key: "a3a1d05125c73c9b07b90ecd0c10f2b8"
server_key_iv: "7ad4c30cd95c7668cd01bdb9757ef497"
server_key_version: "encryptionkey@0"
I20260807 06:21:59.568682 25531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:21:59.592886 25531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:21:59.600570 25531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:21:59.600824 25531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:21:59.608507 25531 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:33515
I20260807 06:21:59.608533 25624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:33515 every 8 connection(s)
I20260807 06:21:59.609529 25531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:21:59.612387 25625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:21:59.615283 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25531
I20260807 06:21:59.615437 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:21:59.615749 27633 external_mini_cluster.cc:1428] Setting key 898bfa7b0fed16b12d9324e7263ad892
I20260807 06:21:59.618379 25625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8: Bootstrap starting.
I20260807 06:21:59.620605 25625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8: Neither blocks nor log segments found. Creating new log.
I20260807 06:21:59.621340 25625 log.cc:824] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8: Log is configured to *not* fsync() on all Append() calls
I20260807 06:21:59.623370 25625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8: No bootstrap required, opened a new log
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:21:59.627139 25625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } }
I20260807 06:21:59.627355 25625 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:21:59.627417 25625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca6922f094a4952a437dd02af900dc8, State: Initialized, Role: FOLLOWER
I20260807 06:21:59.627851 25625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } }
I20260807 06:21:59.627978 25625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:21:59.628096 25625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:21:59.628232 25625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:21:59.629030 25625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } }
I20260807 06:21:59.629369 25625 leader_election.cc:302] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ca6922f094a4952a437dd02af900dc8; no voters:
I20260807 06:21:59.629693 25625 leader_election.cc:288] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:21:59.629812 25632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:21:59.630003 25632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca6922f094a4952a437dd02af900dc8, State: Running, Role: LEADER
I20260807 06:21:59.630290 25632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } }
I20260807 06:21:59.630983 25625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:21:59.631760 25630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:59.617153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38275 (local address 127.26.252.126:33515)
0807 06:21:59.617585 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:59.617599 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:59.617634 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:21:59.618247 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:59.618263 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:59.618698 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:59.619025 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:59.619827 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:59.620878 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:59.621789 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:59.622268 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:59.622463 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:59.625390 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:59.625395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:59.625407 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:59.625433 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:59.627922 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:59.628589 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:59.628595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:59.628603 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:59.628719 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:59.629081 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:59.629085 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:59.629087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:59.629563 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:59.629801 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:59.630501 (+ 700us) server_negotiation.cc:299] Negotiation successful
0807 06:21:59.630739 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":136,"threads_started":1}
I20260807 06:21:59.632779 25634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ca6922f094a4952a437dd02af900dc8. Latest consensus state: current_term: 1 leader_uuid: "5ca6922f094a4952a437dd02af900dc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } } }
I20260807 06:21:59.632910 25634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:59.633669 25656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:21:59.633632 25633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ca6922f094a4952a437dd02af900dc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca6922f094a4952a437dd02af900dc8" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 33515 } } }
I20260807 06:21:59.633795 25633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8 [sys.catalog]: This master's current role is: LEADER
I20260807 06:21:59.635291 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:21:59.636482 25656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:21:59.642952 25656 catalog_manager.cc:1347] Generated new cluster ID: 89c5c9d0f2fa42f49aa83e7db5562ae9
I20260807 06:21:59.643021 25656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:21:59.645788 25630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:21:59.637596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60907 (local address 127.26.252.126:33515)
0807 06:21:59.637691 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 06:21:59.637695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:21:59.637924 (+ 229us) server_negotiation.cc:407] Connection header received
0807 06:21:59.638023 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:21:59.638026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:21:59.638073 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:21:59.638160 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:21:59.638919 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:59.639456 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:59.640284 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:21:59.640517 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:21:59.640622 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:21:59.642241 (+ 1619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:21:59.642244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:21:59.642247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:21:59.642271 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:21:59.643969 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:59.644462 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:59.644466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:59.644468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:59.644549 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:21:59.644885 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:21:59.644888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:21:59.644890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:21:59.645071 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:21:59.645241 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 06:21:59.645509 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 06:21:59.645600 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 06:21:59.653927 25656 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:21:59.655087 25656 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:21:59.669226 25656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ca6922f094a4952a437dd02af900dc8: Generated new TSK 0
I20260807 06:21:59.670013 25656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:21:59.679708 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25531
W20260807 06:21:59.689574 25515 connection.cc:535] client connection to 127.26.252.126:33515 recv error: Network error: failed to read from TLS socket (remote: 127.26.252.126:33515): Connection reset by peer (error 104)
2026-08-07T06:21:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1641 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25676](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25676](info): set up 2 sockets
Aug 07 06:21:59 dist-test-slave-68xk krb5kdc[25676](info): commencing operation
krb5kdc: starting...
W20260807 06:22:00.924993 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:01 dist-test-slave-68xk krb5kdc[25676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:01.059911 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:32839
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:32839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:01.171408 25693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:01.171701 25693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:01.171811 25693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:01.175815 25693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:01.175894 25693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:01.175931 25693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:01.175987 25693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:01.176036 25693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:01.181284 25693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:32839
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:32839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:01.182320 25693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:01.183338 25693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:01.191862 25699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:01.191885 25698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:01.191980 25693 server_base.cc:1034] running on GCE node
W20260807 06:22:01.192118 25701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:01.192669 25693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:01.193871 25693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:01.195081 25693 hybrid_clock.cc:648] HybridClock initialized: now 1786083721195049 us; error 52 us; skew 500 ppm
Aug 07 06:22:01 dist-test-slave-68xk krb5kdc[25676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083721, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:01.198004 25693 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:01.199047 25693 webserver.cc:460] Webserver started at http://127.26.252.126:39763/ using document root <none> and password file <none>
I20260807 06:22:01.199656 25693 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:01.199762 25693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:01.200013 25693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:01.202203 25693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "cbe52b452b534951984b81a677d7c673"
format_stamp: "Formatted at 2026-08-07 06:22:01 on dist-test-slave-68xk"
server_key: "e0d85587f7835a0847542ec3bf17c08a"
server_key_iv: "06cf6c8a7e8d5523d56a8b51fe10654a"
server_key_version: "encryptionkey@0"
I20260807 06:22:01.202889 25693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "cbe52b452b534951984b81a677d7c673"
format_stamp: "Formatted at 2026-08-07 06:22:01 on dist-test-slave-68xk"
server_key: "e0d85587f7835a0847542ec3bf17c08a"
server_key_iv: "06cf6c8a7e8d5523d56a8b51fe10654a"
server_key_version: "encryptionkey@0"
I20260807 06:22:01.207402 25693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:22:01.210026 25711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:01.211503 25693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:22:01.211707 25693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "cbe52b452b534951984b81a677d7c673"
format_stamp: "Formatted at 2026-08-07 06:22:01 on dist-test-slave-68xk"
server_key: "e0d85587f7835a0847542ec3bf17c08a"
server_key_iv: "06cf6c8a7e8d5523d56a8b51fe10654a"
server_key_version: "encryptionkey@0"
I20260807 06:22:01.211884 25693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:01.241863 25693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:01.245388 25693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:01.245642 25693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:01.253365 25693 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:32839
I20260807 06:22:01.253381 25782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:32839 every 8 connection(s)
I20260807 06:22:01.254455 25693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:01.257184 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25693
I20260807 06:22:01.257362 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:01.257375 25783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:01.257699 27633 external_mini_cluster.cc:1428] Setting key caf27faddda970226d7e04e9953deaa0
I20260807 06:22:01.264143 25783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: Bootstrap starting.
I20260807 06:22:01.266732 25783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:01.267530 25783 log.cc:824] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:01.267577 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:01.259124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40005 (local address 127.26.252.126:32839)
0807 06:22:01.259589 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:01.259612 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:01.259651 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:22:01.260594 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:01.260614 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:01.260965 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:01.261266 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:01.261589 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:01.262743 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:01.263967 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:01.264532 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:01.264677 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:01.265649 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:01.265654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:01.265667 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:01.266067 (+ 400us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:01.266131 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:01.266155 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:01.266260 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:01.266575 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 06:22:01.266736 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":163,"threads_started":1}
I20260807 06:22:01.269704 25783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: No bootstrap required, opened a new log
I20260807 06:22:01.270740 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:01.273818 25783 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } }
I20260807 06:22:01.274055 25783 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:22:01.274121 25783 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbe52b452b534951984b81a677d7c673, State: Initialized, Role: FOLLOWER
I20260807 06:22:01.274588 25783 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } }
I20260807 06:22:01.274751 25783 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:22:01.274819 25783 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:22:01.274919 25783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:01.275974 25783 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } }
I20260807 06:22:01.276341 25783 leader_election.cc:302] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbe52b452b534951984b81a677d7c673; no voters:
I20260807 06:22:01.276703 25783 leader_election.cc:288] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:22:01.276813 25800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:01.277074 25800 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [term 1 LEADER]: Becoming Leader. State: Replica: cbe52b452b534951984b81a677d7c673, State: Running, Role: LEADER
I20260807 06:22:01.277307 25786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:01.272881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57091 (local address 127.26.252.126:32839)
0807 06:22:01.273004 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:01.273008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:01.273150 (+ 142us) server_negotiation.cc:407] Connection header received
0807 06:22:01.273260 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:01.273262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:01.273305 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:01.273372 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:01.273663 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:01.274370 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:01.275503 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:01.275767 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:01.275854 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:01.276738 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:01.276745 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:01.276747 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:01.276761 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:01.276790 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:01.276807 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:01.276921 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:01.277154 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 06:22:01.277187 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:22:01.277405 25800 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } }
I20260807 06:22:01.278074 25783 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:01.278683 25803 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbe52b452b534951984b81a677d7c673. Latest consensus state: current_term: 1 leader_uuid: "cbe52b452b534951984b81a677d7c673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } } }
I20260807 06:22:01.278910 25803 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:01.279165 25801 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbe52b452b534951984b81a677d7c673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbe52b452b534951984b81a677d7c673" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 32839 } } }
I20260807 06:22:01.279274 25801 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673 [sys.catalog]: This master's current role is: LEADER
W20260807 06:22:01.282955 25821 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:01.283026 25821 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:01.283118 25812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:01.284008 25812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:01.289747 25812 catalog_manager.cc:1347] Generated new cluster ID: dc24dae6a28746cfb7979b9fc5f744de
I20260807 06:22:01.289820 25812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:01.301237 25812 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:01.302383 25812 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:01.308571 25812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbe52b452b534951984b81a677d7c673: Generated new TSK 0
I20260807 06:22:01.309335 25812 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:22:01.313597 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25693
W20260807 06:22:01.328656 25673 connection.cc:535] client connection to 127.26.252.126:32839 recv error: Network error: failed to read from TLS socket (remote: 127.26.252.126:32839): Connection reset by peer (error 104)
2026-08-07T06:22:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1638 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:01 dist-test-slave-68xk krb5kdc[25829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:01 dist-test-slave-68xk krb5kdc[25829](info): set up 2 sockets
Aug 07 06:22:01 dist-test-slave-68xk krb5kdc[25829](info): commencing operation
krb5kdc: starting...
W20260807 06:22:02.536098 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:02 dist-test-slave-68xk krb5kdc[25829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:02.665470 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34379
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:39121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34379
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:02.778255 25851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:02.778525 25851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:02.778604 25851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:02.782630 25851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:02.782687 25851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:02.782707 25851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:02.782724 25851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:02.782779 25851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:02.788087 25851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:39121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34379
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34379
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:02.789170 25851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:02.790215 25851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:02.799608 25858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:02.799602 25859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:02.799731 25851 server_base.cc:1034] running on GCE node
W20260807 06:22:02.799602 25863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:02.800418 25851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:02.801599 25851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:02.802806 25851 hybrid_clock.cc:648] HybridClock initialized: now 1786083722802777 us; error 42 us; skew 500 ppm
Aug 07 06:22:02 dist-test-slave-68xk krb5kdc[25829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083722, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:02.805616 25851 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:02.806560 25851 webserver.cc:460] Webserver started at http://127.26.252.126:36811/ using document root <none> and password file <none>
I20260807 06:22:02.807142 25851 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:02.807235 25851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:02.807480 25851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:02.809634 25851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "7c29bbcac4e24e3a923b3909bc473163"
format_stamp: "Formatted at 2026-08-07 06:22:02 on dist-test-slave-68xk"
server_key: "963842428303e3e2d5765f339bddafaa"
server_key_iv: "8101b9f8501d9d736230d0b8acc29348"
server_key_version: "encryptionkey@0"
I20260807 06:22:02.810209 25851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "7c29bbcac4e24e3a923b3909bc473163"
format_stamp: "Formatted at 2026-08-07 06:22:02 on dist-test-slave-68xk"
server_key: "963842428303e3e2d5765f339bddafaa"
server_key_iv: "8101b9f8501d9d736230d0b8acc29348"
server_key_version: "encryptionkey@0"
I20260807 06:22:02.814038 25851 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:22:02.816491 25872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:02.817667 25851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:22:02.817826 25851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "7c29bbcac4e24e3a923b3909bc473163"
format_stamp: "Formatted at 2026-08-07 06:22:02 on dist-test-slave-68xk"
server_key: "963842428303e3e2d5765f339bddafaa"
server_key_iv: "8101b9f8501d9d736230d0b8acc29348"
server_key_version: "encryptionkey@0"
I20260807 06:22:02.817937 25851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:02.822482 25851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:02.825232 25851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:02.825423 25851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:02.832336 25851 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34379
I20260807 06:22:02.832393 25950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34379 every 8 connection(s)
I20260807 06:22:02.833278 25851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:02.836181 25951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:02.841813 25951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: Bootstrap starting.
I20260807 06:22:02.842217 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 25851
I20260807 06:22:02.842381 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:02.842686 27633 external_mini_cluster.cc:1428] Setting key bc126868a929c9c8ff5c7519b1f78580
I20260807 06:22:02.844580 25951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:02.845350 25951 log.cc:824] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:02.847760 25951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: No bootstrap required, opened a new log
I20260807 06:22:02.848150 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:02.844119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59383 (local address 127.26.252.126:34379)
0807 06:22:02.844573 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:02.844587 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:02.844622 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:22:02.845308 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:02.845325 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:02.845656 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:02.846033 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:02.846883 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:02.846887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:02.846899 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:02.846909 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:02.846960 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:02.846979 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:02.847065 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:02.847220 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:22:02.847423 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":141,"threads_started":1}
I20260807 06:22:02.851223 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:02.851998 25951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } }
I20260807 06:22:02.852216 25951 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:22:02.852274 25951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c29bbcac4e24e3a923b3909bc473163, State: Initialized, Role: FOLLOWER
I20260807 06:22:02.852788 25951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } }
I20260807 06:22:02.852918 25951 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:22:02.853004 25951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:22:02.853113 25951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:02.854369 25951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } }
I20260807 06:22:02.854789 25951 leader_election.cc:302] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c29bbcac4e24e3a923b3909bc473163; no voters:
I20260807 06:22:02.855202 25951 leader_election.cc:288] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:22:02.855331 25956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:02.853264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51675 (local address 127.26.252.126:34379)
0807 06:22:02.853383 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:02.853387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:02.853796 (+ 409us) server_negotiation.cc:407] Connection header received
0807 06:22:02.853903 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:02.853905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:02.853933 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:02.853995 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:02.854778 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:02.854781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:02.854783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:02.854793 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:02.854817 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:02.854827 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:02.854895 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:02.855179 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 06:22:02.855221 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 06:22:02.855346 25965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:02.855597 25965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [term 1 LEADER]: Becoming Leader. State: Replica: 7c29bbcac4e24e3a923b3909bc473163, State: Running, Role: LEADER
I20260807 06:22:02.855907 25965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } }
I20260807 06:22:02.856541 25951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:02.857125 25966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c29bbcac4e24e3a923b3909bc473163. Latest consensus state: current_term: 1 leader_uuid: "7c29bbcac4e24e3a923b3909bc473163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } } }
I20260807 06:22:02.857265 25966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:02.857605 25970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c29bbcac4e24e3a923b3909bc473163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c29bbcac4e24e3a923b3909bc473163" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34379 } } }
I20260807 06:22:02.857705 25970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163 [sys.catalog]: This master's current role is: LEADER
W20260807 06:22:02.861824 25987 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:02.861932 25987 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:02.862032 25976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:02.862955 25976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:02.868350 25976 catalog_manager.cc:1347] Generated new cluster ID: c350a22bb7ef40cf9fb8fca82a78cf2d
I20260807 06:22:02.868417 25976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:02.885529 25976 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:02.885876 25976 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:02.904464 25976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c29bbcac4e24e3a923b3909bc473163: Generated new TSK 0
I20260807 06:22:02.905205 25976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:22:02.910501 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 25851
2026-08-07T06:22:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1593 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:02 dist-test-slave-68xk krb5kdc[25995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:02 dist-test-slave-68xk krb5kdc[25995](info): set up 2 sockets
Aug 07 06:22:02 dist-test-slave-68xk krb5kdc[25995](info): commencing operation
krb5kdc: starting...
W20260807 06:22:04.127697 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[25995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:04.261246 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40007
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:34969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:40007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:04.373426 26012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:04.373739 26012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:04.373821 26012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:04.377861 26012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:04.377946 26012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:04.377985 26012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:04.378039 26012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:04.378077 26012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:04.383337 26012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:34969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:40007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:40007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:04.384409 26012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:04.385502 26012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:04.394011 26021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:04.394019 26020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:04.394028 26026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:04.394407 26012 server_base.cc:1034] running on GCE node
I20260807 06:22:04.394939 26012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:04.396023 26012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:04.397279 26012 hybrid_clock.cc:648] HybridClock initialized: now 1786083724397258 us; error 31 us; skew 500 ppm
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[25995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083724, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:04.400058 26012 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:04.400861 26012 webserver.cc:460] Webserver started at http://127.26.252.126:37711/ using document root <none> and password file <none>
I20260807 06:22:04.401381 26012 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:04.401438 26012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:04.401599 26012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:04.403635 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "9196dba9cda94228903bf6b4530a54d0"
format_stamp: "Formatted at 2026-08-07 06:22:04 on dist-test-slave-68xk"
server_key: "d1de6e466e13e90d2eddc2498dae8d91"
server_key_iv: "8dbe10dfb727adb2e33954ead3d1a881"
server_key_version: "encryptionkey@0"
I20260807 06:22:04.404151 26012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "9196dba9cda94228903bf6b4530a54d0"
format_stamp: "Formatted at 2026-08-07 06:22:04 on dist-test-slave-68xk"
server_key: "d1de6e466e13e90d2eddc2498dae8d91"
server_key_iv: "8dbe10dfb727adb2e33954ead3d1a881"
server_key_version: "encryptionkey@0"
I20260807 06:22:04.407886 26012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:22:04.410386 26035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:04.411813 26012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:22:04.411929 26012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "9196dba9cda94228903bf6b4530a54d0"
format_stamp: "Formatted at 2026-08-07 06:22:04 on dist-test-slave-68xk"
server_key: "d1de6e466e13e90d2eddc2498dae8d91"
server_key_iv: "8dbe10dfb727adb2e33954ead3d1a881"
server_key_version: "encryptionkey@0"
I20260807 06:22:04.412022 26012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:04.436419 26012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:04.439700 26012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:04.439878 26012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:04.447521 26012 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:40007
I20260807 06:22:04.447535 26111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:40007 every 8 connection(s)
I20260807 06:22:04.448549 26012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:04.451494 26116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:04.457038 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: Bootstrap starting.
I20260807 06:22:04.458340 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26012
I20260807 06:22:04.458513 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:04.458824 27633 external_mini_cluster.cc:1428] Setting key fbf4446c4439c32704f7e863a784a7bb
I20260807 06:22:04.460062 26116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:04.461015 26116 log.cc:824] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:04.463213 26116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: No bootstrap required, opened a new log
I20260807 06:22:04.467392 26116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } }
I20260807 06:22:04.467635 26116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:22:04.467737 26116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9196dba9cda94228903bf6b4530a54d0, State: Initialized, Role: FOLLOWER
I20260807 06:22:04.468156 26116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } }
I20260807 06:22:04.468315 26116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:22:04.468387 26116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:22:04.468513 26116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[25995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:04.469485 26116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } }
I20260807 06:22:04.469867 26116 leader_election.cc:302] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9196dba9cda94228903bf6b4530a54d0; no voters:
I20260807 06:22:04.470268 26116 leader_election.cc:288] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:22:04.470407 26121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:04.470685 26121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [term 1 LEADER]: Becoming Leader. State: Replica: 9196dba9cda94228903bf6b4530a54d0, State: Running, Role: LEADER
I20260807 06:22:04.471088 26121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } }
I20260807 06:22:04.471640 26116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:04.473582 26122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9196dba9cda94228903bf6b4530a54d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } } }
I20260807 06:22:04.473738 26122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:04.473579 26123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9196dba9cda94228903bf6b4530a54d0. Latest consensus state: current_term: 1 leader_uuid: "9196dba9cda94228903bf6b4530a54d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9196dba9cda94228903bf6b4530a54d0" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 40007 } } }
I20260807 06:22:04.473829 26123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:04.476490 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:04.459968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55203 (local address 127.26.252.126:40007)
0807 06:22:04.460427 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:04.460446 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:04.460487 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:22:04.461325 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:04.461351 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:04.461707 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:04.462082 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:04.462969 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:04.464444 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:04.465466 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:04.466269 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:04.466472 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:04.469554 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:04.469561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:04.469581 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:04.469611 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:04.471828 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:04.472428 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:04.472434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:04.472440 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:04.472644 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:04.473034 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:04.473040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:04.473043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:04.473700 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:04.473926 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:04.475098 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0807 06:22:04.475421 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":137,"threads_started":1}
W20260807 06:22:04.476701 26142 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:04.476814 26142 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:04.476890 26143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:04.477593 26143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:04.480084 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:04.483806 26143 catalog_manager.cc:1347] Generated new cluster ID: bd5d10106e7c46e49075c8fe56b8e9d4
I20260807 06:22:04.483925 26143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:04.492753 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:04.482397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55765 (local address 127.26.252.126:40007)
0807 06:22:04.482536 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:04.482542 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:04.482871 (+ 329us) server_negotiation.cc:407] Connection header received
0807 06:22:04.482997 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:04.483000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:04.483048 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:04.483135 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:04.484073 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:04.484974 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:04.486342 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:04.486795 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:04.486892 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:04.488824 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:04.488828 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:04.488832 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:04.488861 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:04.490644 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:04.491203 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:04.491207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:04.491209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:04.491303 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:04.491642 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:04.491646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:04.491648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:04.491890 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:04.492005 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:04.492406 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 06:22:04.492537 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:22:04.494606 26143 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:04.495460 26143 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:04.504693 26143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9196dba9cda94228903bf6b4530a54d0: Generated new TSK 0
I20260807 06:22:04.505357 26143 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:22:04.511698 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26012
2026-08-07T06:22:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[26163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[26163](info): set up 2 sockets
Aug 07 06:22:04 dist-test-slave-68xk krb5kdc[26163](info): commencing operation
krb5kdc: starting...
W20260807 06:22:05.777565 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:05 dist-test-slave-68xk krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:05.910696 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43357
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:42329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:43357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:06.035248 26188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:06.035568 26188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:06.035660 26188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:06.040105 26188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:06.040205 26188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:06.040249 26188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:06.040313 26188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:06.040359 26188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:06.046098 26188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:42329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:43357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:43357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:06.047247 26188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:06.048358 26188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:06.057331 26195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:06.057384 26199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:06.057417 26201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:06.057600 26188 server_base.cc:1034] running on GCE node
I20260807 06:22:06.058295 26188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:06.059484 26188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:06.060707 26188 hybrid_clock.cc:648] HybridClock initialized: now 1786083726060687 us; error 33 us; skew 500 ppm
Aug 07 06:22:06 dist-test-slave-68xk krb5kdc[26163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083726, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:06.068917 26188 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:06.069891 26188 webserver.cc:460] Webserver started at http://127.26.252.126:41907/ using document root <none> and password file <none>
I20260807 06:22:06.070550 26188 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:06.070648 26188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:06.070904 26188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:06.072986 26188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd"
format_stamp: "Formatted at 2026-08-07 06:22:06 on dist-test-slave-68xk"
server_key: "a7eb08b496630e9fa6791c015c3f0ba3"
server_key_iv: "e76736e0a55ce787f52be999954ae4b2"
server_key_version: "encryptionkey@0"
I20260807 06:22:06.073565 26188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd"
format_stamp: "Formatted at 2026-08-07 06:22:06 on dist-test-slave-68xk"
server_key: "a7eb08b496630e9fa6791c015c3f0ba3"
server_key_iv: "e76736e0a55ce787f52be999954ae4b2"
server_key_version: "encryptionkey@0"
I20260807 06:22:06.077405 26188 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 06:22:06.080044 26213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:06.081468 26188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:22:06.081612 26188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd"
format_stamp: "Formatted at 2026-08-07 06:22:06 on dist-test-slave-68xk"
server_key: "a7eb08b496630e9fa6791c015c3f0ba3"
server_key_iv: "e76736e0a55ce787f52be999954ae4b2"
server_key_version: "encryptionkey@0"
I20260807 06:22:06.081734 26188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:06.097450 26188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:06.100755 26188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:06.100975 26188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:06.108220 26188 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:43357
I20260807 06:22:06.108312 26289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:43357 every 8 connection(s)
I20260807 06:22:06.109194 26188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:06.112202 26290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:06.118038 26290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd: Bootstrap starting.
I20260807 06:22:06.118579 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26188
I20260807 06:22:06.118758 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:06.119084 27633 external_mini_cluster.cc:1428] Setting key 8dc1229ebc4924b58c53362b76152189
I20260807 06:22:06.121188 26290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:06.122001 26290 log.cc:824] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:06.124063 26290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd: No bootstrap required, opened a new log
I20260807 06:22:06.128165 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:06.120532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44529 (local address 127.26.252.126:43357)
0807 06:22:06.120995 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:06.121011 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:06.121047 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:22:06.121765 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:06.121783 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:06.122182 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:06.122560 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:06.122968 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:06.123914 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:06.124870 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:06.125345 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:06.125524 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:06.126488 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:06.126493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:06.126505 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:06.126886 (+ 381us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:06.126938 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:06.126960 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:06.127073 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:06.127227 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 06:22:06.127431 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":134,"threads_started":1}
I20260807 06:22:06.128333 26290 raft_consensus.cc:348] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } }
I20260807 06:22:06.128600 26290 raft_consensus.cc:374] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:22:06.128688 26290 raft_consensus.cc:729] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b72bf8cac88c44919ec4bdac9d4a7bfd, State: Initialized, Role: FOLLOWER
I20260807 06:22:06.129161 26290 consensus_queue.cc:260] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } }
I20260807 06:22:06.129355 26290 raft_consensus.cc:388] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:22:06.129426 26290 raft_consensus.cc:482] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:22:06.129529 26290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:06.130824 26290 raft_consensus.cc:504] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } }
I20260807 06:22:06.131237 26290 leader_election.cc:302] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b72bf8cac88c44919ec4bdac9d4a7bfd; no voters:
I20260807 06:22:06.131393 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:06.131654 26290 leader_election.cc:288] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:22:06.131726 26302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:06.131981 26302 raft_consensus.cc:686] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [term 1 LEADER]: Becoming Leader. State: Replica: b72bf8cac88c44919ec4bdac9d4a7bfd, State: Running, Role: LEADER
I20260807 06:22:06.132359 26302 consensus_queue.cc:237] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } }
I20260807 06:22:06.133030 26290 sys_catalog.cc:564] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:06.134120 26303 sys_catalog.cc:455] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } } }
I20260807 06:22:06.134279 26303 sys_catalog.cc:458] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:06.134654 26303 sys_catalog.cc:455] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b72bf8cac88c44919ec4bdac9d4a7bfd. Latest consensus state: current_term: 1 leader_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b72bf8cac88c44919ec4bdac9d4a7bfd" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 43357 } } }
I20260807 06:22:06.134753 26303 sys_catalog.cc:458] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:06.135726 26323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:06.138490 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:06.133551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48529 (local address 127.26.252.126:43357)
0807 06:22:06.133666 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:06.133670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:06.133940 (+ 270us) server_negotiation.cc:407] Connection header received
0807 06:22:06.134126 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:06.134129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:06.134173 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:06.134223 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:06.134684 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:06.135346 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:06.136556 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:06.136919 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:06.137065 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:06.137940 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:06.137944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:06.137947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:06.137961 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:06.137991 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:06.138004 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:06.138092 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:06.138205 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 06:22:06.138269 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:22:06.140503 26323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:06.146962 26323 catalog_manager.cc:1347] Generated new cluster ID: a4c2fdd98f2247ec88ca7ec962841d89
I20260807 06:22:06.147030 26323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:06.154584 26323 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:06.155529 26323 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:06.166940 26323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b72bf8cac88c44919ec4bdac9d4a7bfd: Generated new TSK 0
I20260807 06:22:06.167717 26323 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:22:06.179100 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26188
2026-08-07T06:22:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1667 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:06 dist-test-slave-68xk krb5kdc[26339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:06 dist-test-slave-68xk krb5kdc[26339](info): set up 2 sockets
Aug 07 06:22:06 dist-test-slave-68xk krb5kdc[26339](info): commencing operation
krb5kdc: starting...
W20260807 06:22:07.433658 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:07 dist-test-slave-68xk krb5kdc[26339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:07.563506 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42133
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:42133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:07.678452 26356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:07.678725 26356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:07.678766 26356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:07.682755 26356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:07.682814 26356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:07.682834 26356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:07.682852 26356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:07.682868 26356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:07.688299 26356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:42133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:42133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:07.689306 26356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:07.690308 26356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:22:07.698921 26356 server_base.cc:1034] running on GCE node
W20260807 06:22:07.698871 26372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:07.698880 26364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:07.698875 26369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:07.699648 26356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:07.700680 26356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:07.701845 26356 hybrid_clock.cc:648] HybridClock initialized: now 1786083727701818 us; error 41 us; skew 500 ppm
Aug 07 06:22:07 dist-test-slave-68xk krb5kdc[26339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083727, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:07.704674 26356 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:07.705554 26356 webserver.cc:460] Webserver started at http://127.26.252.126:37251/ using document root <none> and password file <none>
I20260807 06:22:07.706197 26356 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:07.706274 26356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:07.706501 26356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:07.709012 26356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "121bb4b2465b40c6af25c450b62baf1e"
format_stamp: "Formatted at 2026-08-07 06:22:07 on dist-test-slave-68xk"
server_key: "ed2465103a7b10fc4c2e712333b526d3"
server_key_iv: "1e76ebcaeb85b5376e3f712b30e53433"
server_key_version: "encryptionkey@0"
I20260807 06:22:07.709517 26356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "121bb4b2465b40c6af25c450b62baf1e"
format_stamp: "Formatted at 2026-08-07 06:22:07 on dist-test-slave-68xk"
server_key: "ed2465103a7b10fc4c2e712333b526d3"
server_key_iv: "1e76ebcaeb85b5376e3f712b30e53433"
server_key_version: "encryptionkey@0"
I20260807 06:22:07.713197 26356 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 06:22:07.715664 26380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:07.717008 26356 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 06:22:07.717159 26356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "121bb4b2465b40c6af25c450b62baf1e"
format_stamp: "Formatted at 2026-08-07 06:22:07 on dist-test-slave-68xk"
server_key: "ed2465103a7b10fc4c2e712333b526d3"
server_key_iv: "1e76ebcaeb85b5376e3f712b30e53433"
server_key_version: "encryptionkey@0"
I20260807 06:22:07.717255 26356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:07.721778 26356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:07.724812 26356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:07.724956 26356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:07.732092 26356 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:42133
I20260807 06:22:07.732100 26467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:42133 every 8 connection(s)
I20260807 06:22:07.732993 26356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:07.735818 26469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:07.740020 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26356
I20260807 06:22:07.740190 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:07.740469 27633 external_mini_cluster.cc:1428] Setting key c70e4f3a10513ad666045b09199f0cf9
I20260807 06:22:07.741900 26469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e: Bootstrap starting.
I20260807 06:22:07.744385 26469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:07.745290 26469 log.cc:824] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:07.745811 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:07.741819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38077 (local address 127.26.252.126:42133)
0807 06:22:07.742275 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:07.742301 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:07.742337 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:22:07.743014 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:07.743030 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:07.743294 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:07.743561 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:07.744440 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:07.744445 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:07.744456 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:07.744466 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:07.744551 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:07.744587 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:07.744690 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:07.744853 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 06:22:07.745024 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":215,"threads_started":1}
I20260807 06:22:07.747354 26469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e: No bootstrap required, opened a new log
I20260807 06:22:07.748749 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:07.752012 26469 raft_consensus.cc:348] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } }
I20260807 06:22:07.752259 26469 raft_consensus.cc:374] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:22:07.752329 26469 raft_consensus.cc:729] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 121bb4b2465b40c6af25c450b62baf1e, State: Initialized, Role: FOLLOWER
I20260807 06:22:07.752796 26469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } }
I20260807 06:22:07.752907 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:07.751207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35811 (local address 127.26.252.126:42133)
0807 06:22:07.751334 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:07.751339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:07.751513 (+ 174us) server_negotiation.cc:407] Connection header received
0807 06:22:07.751598 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:07.751601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:07.751636 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:07.751731 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:07.752487 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:07.752491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:07.752493 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:22:07.752505 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:07.752534 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:22:07.752546 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:07.752638 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:07.752723 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 06:22:07.752759 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:22:07.752981 26469 raft_consensus.cc:388] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:22:07.753047 26469 raft_consensus.cc:482] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:22:07.753160 26469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:07.754179 26469 raft_consensus.cc:504] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } }
I20260807 06:22:07.754529 26469 leader_election.cc:302] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 121bb4b2465b40c6af25c450b62baf1e; no voters:
I20260807 06:22:07.754805 26469 leader_election.cc:288] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:22:07.754904 26482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:07.755116 26482 raft_consensus.cc:686] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [term 1 LEADER]: Becoming Leader. State: Replica: 121bb4b2465b40c6af25c450b62baf1e, State: Running, Role: LEADER
I20260807 06:22:07.755440 26482 consensus_queue.cc:237] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } }
I20260807 06:22:07.756012 26469 sys_catalog.cc:564] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:07.757076 26485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 121bb4b2465b40c6af25c450b62baf1e. Latest consensus state: current_term: 1 leader_uuid: "121bb4b2465b40c6af25c450b62baf1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } } }
I20260807 06:22:07.757217 26485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:07.757368 26484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "121bb4b2465b40c6af25c450b62baf1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "121bb4b2465b40c6af25c450b62baf1e" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 42133 } } }
I20260807 06:22:07.757547 26484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:07.758184 26494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:07.760768 26494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:07.765872 26494 catalog_manager.cc:1347] Generated new cluster ID: e7ed46fae26a4bd08596e99fb3886bd5
I20260807 06:22:07.765947 26494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:07.776516 26494 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:07.776808 26494 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:07.784955 26494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 121bb4b2465b40c6af25c450b62baf1e: Generated new TSK 0
I20260807 06:22:07.785890 26494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:22:07.795203 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26356
2026-08-07T06:22:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1616 ms)
[----------] 18 tests from AuthTokenIssuingTest (29251 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:07 dist-test-slave-68xk krb5kdc[26513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:07 dist-test-slave-68xk krb5kdc[26513](info): set up 2 sockets
Aug 07 06:22:07 dist-test-slave-68xk krb5kdc[26513](info): commencing operation
krb5kdc: starting...
W20260807 06:22:09.055745 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:09.186923 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35081
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:09.300175 26529 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:09.300518 26529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:09.300594 26529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:09.300670 26529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:09.304586 26529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:09.304673 26529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:09.304713 26529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:09.304749 26529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:09.304781 26529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:09.309914 26529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:35081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:09.310963 26529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:09.311956 26529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:09.320593 26535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:09.320586 26536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:09.320566 26542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:09.320894 26529 server_base.cc:1034] running on GCE node
I20260807 06:22:09.321554 26529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:09.322733 26529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:09.323923 26529 hybrid_clock.cc:648] HybridClock initialized: now 1786083729323905 us; error 30 us; skew 500 ppm
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:09.326808 26529 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:09.327657 26529 webserver.cc:460] Webserver started at http://127.26.252.126:38499/ using document root <none> and password file <none>
I20260807 06:22:09.328224 26529 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:09.328320 26529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:09.328552 26529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:09.330662 26529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "6b264235913c42298416b7305641cc32"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "b57cc710f0add61c2580e69c7bd6cc6c"
server_key_iv: "0e98fe5b4f2c3601ed98fa5222a32718"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.331240 26529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "6b264235913c42298416b7305641cc32"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "b57cc710f0add61c2580e69c7bd6cc6c"
server_key_iv: "0e98fe5b4f2c3601ed98fa5222a32718"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.334978 26529 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:22:09.337350 26550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:09.338682 26529 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:22:09.338822 26529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "6b264235913c42298416b7305641cc32"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "b57cc710f0add61c2580e69c7bd6cc6c"
server_key_iv: "0e98fe5b4f2c3601ed98fa5222a32718"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.338930 26529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:09.350172 26529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:09.353425 26529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:09.353633 26529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:09.360903 26529 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:35081
I20260807 06:22:09.361213 26619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:35081 every 8 connection(s)
I20260807 06:22:09.361881 26529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:09.364389 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26529
I20260807 06:22:09.364540 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:09.364859 27633 external_mini_cluster.cc:1428] Setting key 9f56ed3ada87fc360faaccb651fce646
I20260807 06:22:09.365010 26620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:09.370839 26620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.252.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.125@KRBTEST.COM" created.
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:09.390638 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.373746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35081 (local address 127.0.0.1:38038)
0807 06:22:09.374275 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.374330 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.375323 (+ 993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.376227 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.376233 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.376668 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.377084 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.377103 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.378747 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.378750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.379830 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.379841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.380805 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.380808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.380922 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.381541 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.381562 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.385170 (+ 3608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.387246 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.387259 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.387272 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.387656 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.388095 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.388102 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.388108 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.388286 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.389131 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.389136 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.389275 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.389422 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.389680 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":38,"thread_start_us":138,"threads_started":1}
I20260807 06:22:09.390645 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.374674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.26.252.126:35081)
0807 06:22:09.375030 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.375041 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.375090 (+ 49us) server_negotiation.cc:407] Connection header received
0807 06:22:09.375751 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.375758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.376014 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.376227 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.377251 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.378622 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.379951 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.380475 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.380613 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.385332 (+ 4719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.385342 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.385358 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.385380 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.387116 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.387806 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.387814 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.387816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.387981 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.388411 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.388417 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.388422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.388993 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.389164 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.389573 (+ 409us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.389791 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":232,"thread_start_us":115,"threads_started":1}
I20260807 06:22:09.393478 26620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:09.394254 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.394002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33206)
0807 06:22:09.394124 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.394193 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 06:22:09.394641 26555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
I20260807 06:22:09.395548 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.395348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33208)
0807 06:22:09.395455 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.395498 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:22:09.395777 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:33147: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
I20260807 06:22:09.406191 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:33147
--webserver_interface=127.26.252.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:22:09.445024 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } attempt: 1
I20260807 06:22:09.445972 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.445651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33214)
0807 06:22:09.445825 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.445891 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 06:22:09.446762 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.446540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33220)
0807 06:22:09.446644 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.446694 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 06:22:09.446893 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:33147: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
I20260807 06:22:09.515103 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } attempt: 2
I20260807 06:22:09.516093 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.515759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33234)
0807 06:22:09.515924 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.515998 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 06:22:09.516917 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.516663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33250)
0807 06:22:09.516791 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.516856 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 06:22:09.517072 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:33147: Network error: Client connection negotiation failed: client connection to 127.26.252.125:33147: connect: Connection refused (error 111)
W20260807 06:22:09.520411 26634 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:09.520648 26634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:09.520713 26634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:09.520789 26634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:09.524761 26634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:09.524811 26634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:09.524830 26634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:09.524874 26634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:09.524906 26634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:09.530103 26634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:33147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.252.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:09.531159 26634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:09.532230 26634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:09.540664 26641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:09.540707 26640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:09.540664 26643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:09.540892 26634 server_base.cc:1034] running on GCE node
I20260807 06:22:09.541570 26634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:09.542840 26634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:09.544044 26634 hybrid_clock.cc:648] HybridClock initialized: now 1786083729544004 us; error 52 us; skew 500 ppm
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:09.547040 26634 init.cc:377] Logged in from keytab as kudu/127.26.252.125@KRBTEST.COM (short username kudu)
I20260807 06:22:09.547930 26634 webserver.cc:460] Webserver started at http://127.26.252.125:37221/ using document root <none> and password file <none>
I20260807 06:22:09.548480 26634 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:09.548542 26634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:09.548705 26634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:09.551018 26634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data/instance:
uuid: "f8fe0c9255a841b99b6080fb9346f1ac"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "53447faf6df23e59078c1c63c88fc69f"
server_key_iv: "d6eb8e30643000c633b2b7dd92529ae2"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.551545 26634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal/instance:
uuid: "f8fe0c9255a841b99b6080fb9346f1ac"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "53447faf6df23e59078c1c63c88fc69f"
server_key_iv: "d6eb8e30643000c633b2b7dd92529ae2"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.555260 26634 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:22:09.557619 26656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:09.559046 26634 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:22:09.559187 26634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "f8fe0c9255a841b99b6080fb9346f1ac"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "53447faf6df23e59078c1c63c88fc69f"
server_key_iv: "d6eb8e30643000c633b2b7dd92529ae2"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.559293 26634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:09.574935 26634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:09.578162 26634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:09.578384 26634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:09.586193 26634 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.125:33147
I20260807 06:22:09.586557 26735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.125:33147 every 8 connection(s)
I20260807 06:22:09.587330 26634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
I20260807 06:22:09.590267 26736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:09.593147 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26634
I20260807 06:22:09.593288 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-1/wal/instance
I20260807 06:22:09.593600 27633 external_mini_cluster.cc:1428] Setting key 796e558547d814732da63649e2a5ecb5
I20260807 06:22:09.594655 26736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.252.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.124@KRBTEST.COM" created.
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:09.608261 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } attempt: 3
I20260807 06:22:09.611663 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.596976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38048 (local address 127.26.252.126:35081)
0807 06:22:09.597121 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.597124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.598161 (+ 1037us) server_negotiation.cc:407] Connection header received
0807 06:22:09.599148 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.599152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.599211 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.599322 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.600456 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.601000 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.602142 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.602390 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.602553 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.606737 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.606740 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.606742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.606768 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.608434 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.609560 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.609567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.609572 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.609692 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.610171 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.610177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.610180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.610497 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.610614 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.611335 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.611457 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:22:09.612700 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.597457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35081 (local address 127.0.0.1:38048)
0807 06:22:09.597997 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.598039 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.598939 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.599491 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.599497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.599833 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.600303 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.600316 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.601142 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.601146 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.602003 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.602013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.602593 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.602597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.602814 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.603419 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.603436 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.606553 (+ 3117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.609073 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.609082 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.609098 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.609438 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.609840 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.609846 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.609851 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.610051 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.610627 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.610637 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.611002 (+ 365us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.611248 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.611622 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":170,"threads_started":1}
I20260807 06:22:09.614512 26736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:09.619285 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.608751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33254)
0807 06:22:09.608880 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.608897 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.608966 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.609691 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.609694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.609882 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.610537 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.610549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.611614 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.611617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.612308 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.612318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.612932 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.612936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.613038 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.613552 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.613567 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.615152 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.617422 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.617424 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.617426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.617638 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.618005 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.618008 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.618010 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.618117 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.618688 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.618691 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.618819 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.618922 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.619083 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 06:22:09.619788 26743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.608883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.26.252.125:33147)
0807 06:22:09.609264 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.609277 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.609301 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:22:09.609348 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.609353 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.609551 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.609700 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.610665 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.611479 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.612434 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.612763 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.613287 (+ 524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.615291 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.615301 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.615314 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.615342 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.617283 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.617755 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.617761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.617764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.617865 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.618240 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.618242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.618244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.618564 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.618703 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.619050 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.619242 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":147,"threads_started":1}
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:09.621721 26620 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:09.622572 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.622239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55680)
0807 06:22:09.622405 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.622489 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 06:22:09.623493 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.623125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55696)
0807 06:22:09.623360 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.623414 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260807 06:22:09.623697 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.624279 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.615028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33270)
0807 06:22:09.615125 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.615139 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.615223 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.615702 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.615705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.615875 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.615993 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.616003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.617043 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.617047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.617734 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.617744 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.618469 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.618473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.618598 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.619110 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.619125 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.620598 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.622731 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.622734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.622736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.622976 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.623314 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.623317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.623320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.623417 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.623859 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.623862 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.623965 (+ 103us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.624064 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.624166 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":3}
I20260807 06:22:09.624508 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.615169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.26.252.125:33147)
0807 06:22:09.615487 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.615498 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.615512 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:22:09.615547 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.615552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.615601 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.615694 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.616132 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.616880 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.617927 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.618334 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.618523 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.620838 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.620841 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.620842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.620863 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.622597 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.623099 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.623103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.623106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.623200 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.623502 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.623504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.623506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.623763 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.623867 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.624145 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.624275 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":239,"thread_start_us":116,"threads_started":1}
I20260807 06:22:09.625123 26736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
I20260807 06:22:09.625826 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.625551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55708)
0807 06:22:09.625668 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.625764 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 06:22:09.626056 26662 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.626232 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:39369
--webserver_interface=127.26.252.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:43045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:22:09.627123 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.626842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55724)
0807 06:22:09.626981 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.627044 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 06:22:09.627316 26736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.654852 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 1
I20260807 06:22:09.655706 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.655412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55736)
0807 06:22:09.655565 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.655626 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 06:22:09.656463 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.656214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55746)
0807 06:22:09.656357 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.656409 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 06:22:09.656596 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.676566 26736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 1
I20260807 06:22:09.677456 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.677081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55760)
0807 06:22:09.677286 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.677364 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 06:22:09.678242 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.678004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55768)
0807 06:22:09.678119 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.678176 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 06:22:09.678396 26736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.731772 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 2
I20260807 06:22:09.732676 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.732364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55770)
0807 06:22:09.732525 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.732595 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 06:22:09.733428 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.733177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55786)
0807 06:22:09.733330 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.733374 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260807 06:22:09.733559 26620 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
W20260807 06:22:09.740584 26747 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:09.740914 26747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:09.740978 26747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:09.741058 26747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:09.745272 26747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:09.745357 26747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:09.745395 26747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:09.745455 26747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:09.745494 26747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:09.746592 26736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 2
I20260807 06:22:09.747553 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.747202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55790)
0807 06:22:09.747399 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.747464 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 06:22:09.748270 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.748014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55802)
0807 06:22:09.748115 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.748196 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 06:22:09.748467 26736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:39369: Network error: Client connection negotiation failed: client connection to 127.26.252.124:39369: connect: Connection refused (error 111)
I20260807 06:22:09.751787 26747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:43045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:35081,127.26.252.125:33147,127.26.252.124:39369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:39369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.252.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:09.752939 26747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:09.754015 26747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:09.762539 26758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:09.762665 26747 server_base.cc:1034] running on GCE node
W20260807 06:22:09.762539 26753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:09.762857 26754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:09.763444 26747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:09.764679 26747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:09.765884 26747 hybrid_clock.cc:648] HybridClock initialized: now 1786083729765851 us; error 46 us; skew 500 ppm
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:09.768707 26747 init.cc:377] Logged in from keytab as kudu/127.26.252.124@KRBTEST.COM (short username kudu)
I20260807 06:22:09.769598 26747 webserver.cc:460] Webserver started at http://127.26.252.124:44729/ using document root <none> and password file <none>
I20260807 06:22:09.770116 26747 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:09.770177 26747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:09.770355 26747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:09.772439 26747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data/instance:
uuid: "357275a75c3e446680083faf5912f9f3"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "bd1d788f29238fcc42464dd431477c25"
server_key_iv: "171df4fd7960ec544d818f8b4ed02539"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.772953 26747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal/instance:
uuid: "357275a75c3e446680083faf5912f9f3"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "bd1d788f29238fcc42464dd431477c25"
server_key_iv: "171df4fd7960ec544d818f8b4ed02539"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.776911 26747 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 06:22:09.779348 26765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:09.780556 26747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:22:09.780702 26747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "357275a75c3e446680083faf5912f9f3"
format_stamp: "Formatted at 2026-08-07 06:22:09 on dist-test-slave-68xk"
server_key: "bd1d788f29238fcc42464dd431477c25"
server_key_iv: "171df4fd7960ec544d818f8b4ed02539"
server_key_version: "encryptionkey@0"
I20260807 06:22:09.780812 26747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:09.793958 26747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:09.796865 26747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:09.797072 26747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:09.804517 26747 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.124:39369
I20260807 06:22:09.804842 26842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.124:39369 every 8 connection(s)
I20260807 06:22:09.805526 26747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
I20260807 06:22:09.808429 26843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:09.812139 26843 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:09.813267 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 26747
I20260807 06:22:09.813441 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786083434177398-27633-0/minicluster-data/master-2/wal/instance
I20260807 06:22:09.813736 27633 external_mini_cluster.cc:1428] Setting key 973752a50309a5e6686c67fe1b6d560f
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:09.825888 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.814052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.26.252.126:35081)
0807 06:22:09.814213 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.814244 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.815202 (+ 958us) server_negotiation.cc:407] Connection header received
0807 06:22:09.816051 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.816055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.816120 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.816243 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.817149 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.817639 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.818787 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.819061 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.819140 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.821871 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.821874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.821876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.821900 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.823593 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.824295 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.824298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.824299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.824378 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.824756 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.824760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.824762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.824955 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.825080 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.825579 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.825702 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:22:09.826777 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.814517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:35081 (local address 127.0.0.1:38054)
0807 06:22:09.815061 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.815111 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.815851 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.816309 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.816314 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.816715 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.816997 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.817010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.817756 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.817760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.818652 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.818662 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.819197 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.819201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.819363 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.820055 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.820079 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.821687 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.823744 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.823753 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.823764 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.824188 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.824486 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.824490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.824492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.824642 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.825080 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.825087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.825331 (+ 244us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.825519 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.825816 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":140,"threads_started":1}
I20260807 06:22:09.826783 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.814517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55812 (local address 127.26.252.124:39369)
0807 06:22:09.815063 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.815079 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.815117 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:22:09.815837 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.815855 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.816047 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.816192 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.816979 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.817980 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.818919 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.819373 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.819478 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.822249 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.822255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.822264 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.822285 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.824375 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.824810 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.824816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.824822 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.824895 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.825199 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.825203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.825205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.825452 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.825652 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.825893 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.826028 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":430,"spinlock_wait_cycles":24832,"thread_start_us":168,"threads_started":1}
I20260807 06:22:09.828065 26843 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:09.832702 26620 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 3
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:09.836596 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.828546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:33147 (local address 127.0.0.1:33282)
0807 06:22:09.828669 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.828684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.828795 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.829044 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.829047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.829215 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.829335 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.829341 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.830093 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.830098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.830696 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.830705 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.831178 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.831181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.831278 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.831763 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.831774 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.832979 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.835021 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.835023 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.835024 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.835204 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.835522 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.835528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.835531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.835632 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.836068 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.836074 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.836184 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.836307 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.836430 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 06:22:09.836666 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.828689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33282 (local address 127.26.252.125:33147)
0807 06:22:09.828822 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.828829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.828846 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:22:09.828891 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.828894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.828942 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.829031 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.829465 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.829983 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.830821 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.831059 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.831168 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.833173 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.833176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.833178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.833200 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.834889 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.835317 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.835320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.835322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.835420 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.835745 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.835749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.835751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.835972 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.836070 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.836391 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.836532 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:22:09.837378 26843 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:09.839632 26736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } attempt: 3
I20260807 06:22:09.841635 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.829231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38064 (local address 127.26.252.126:35081)
0807 06:22:09.829395 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.829399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.829412 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:22:09.829505 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.829508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.829544 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.829636 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.830308 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.830922 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.831834 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.832058 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.832163 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.834991 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.834994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.834997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.835021 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.838657 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.839105 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.839108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.839109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.839201 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.839881 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.839888 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.839892 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.840354 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.840569 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.841248 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.841481 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:09.843487 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.833103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55816)
0807 06:22:09.833292 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.833308 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.833658 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.834219 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.834222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.834394 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.834537 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.834544 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.835617 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.835620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.836349 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.836359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.836970 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.836976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.837081 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.837544 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.837561 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.838910 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.841099 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.841104 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.841107 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.841366 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.842357 (+ 991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.842361 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.842363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.842501 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.842979 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.842982 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.843083 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.843173 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.843307 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260807 06:22:09.844096 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.833833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55816 (local address 127.26.252.124:39369)
0807 06:22:09.833969 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.833973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.833987 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:22:09.834023 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.834026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.834070 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.834201 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.834661 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.835424 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.836471 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.836835 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.837305 (+ 470us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.839040 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.839045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.839051 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.839081 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.840975 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.842114 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.842119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.842122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.842226 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.842625 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.842631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.842634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.842856 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.843735 (+ 879us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.843810 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.843923 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:09.847966 26620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: Bootstrap starting.
I20260807 06:22:09.848081 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.837876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55824)
0807 06:22:09.837964 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.837979 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.838045 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.838550 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.838553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.838765 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.838861 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.838867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.840241 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.840247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.841000 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.841009 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.841618 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.841621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.841724 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.842184 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.842198 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.843656 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.845997 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.846000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.846001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.846588 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.847135 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.847138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.847139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.847233 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.847609 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.847611 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.847684 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.847785 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.847926 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 06:22:09.848978 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.837953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55824 (local address 127.26.252.124:39369)
0807 06:22:09.838294 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.838308 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.838318 (+ 10us) server_negotiation.cc:407] Connection header received
0807 06:22:09.838343 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.838345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.838374 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.838540 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.838990 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.840125 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.841122 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.841496 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.841594 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.843795 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.843798 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.843801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.843820 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.845887 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.846689 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.846695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.846700 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.846799 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.847327 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.847330 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.847332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.847509 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.847852 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.847934 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.848062 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":286,"thread_start_us":138,"threads_started":1}
I20260807 06:22:09.850327 26739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.839980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:39369 (local address 127.0.0.1:55828)
0807 06:22:09.840128 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:09.840147 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:09.840231 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:09.840747 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:09.840749 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:09.840917 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:09.841005 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.841010 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.842186 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.842189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.842977 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:09.842989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.843651 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.843654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:09.843738 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.844203 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:09.844223 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:09.845775 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:09.848159 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.848165 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.848167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.848457 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.849172 (+ 715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:09.849177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:09.849181 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:09.849296 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:09.849798 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:09.849801 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:09.849895 (+ 94us) client_negotiation.cc:769] Sending connection context
0807 06:22:09.849989 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:22:09.850144 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
Aug 07 06:22:09 dist-test-slave-68xk krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:09.850914 26620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:09.851047 26850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.840183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55828 (local address 127.26.252.124:39369)
0807 06:22:09.840476 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.840485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.840499 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:22:09.840530 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.840533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.840569 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.841118 (+ 549us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.841254 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.842054 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.843160 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.843507 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.843966 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.845928 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.845932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.845936 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.845965 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.847752 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.848595 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.848599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.848603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.848684 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.849423 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.849426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.849429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.849665 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.850654 (+ 989us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.850738 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.850858 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":225,"thread_start_us":118,"threads_started":1}
I20260807 06:22:09.851882 26620 log.cc:824] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:09.852365 26843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: Bootstrap starting.
I20260807 06:22:09.854259 26620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: No bootstrap required, opened a new log
I20260807 06:22:09.854957 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.843067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.26.252.125:33147)
0807 06:22:09.843171 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.843175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.843319 (+ 144us) server_negotiation.cc:407] Connection header received
0807 06:22:09.843867 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.843872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.843926 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.843973 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.845097 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.845828 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.847065 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.847410 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.847498 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.851230 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.851234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.851236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.851261 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.853015 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.853502 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.853505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.853507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.853599 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.853942 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.853946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.853947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.854148 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.854293 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.854693 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.854820 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:22:09.854935 26736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: Bootstrap starting.
I20260807 06:22:09.855118 26843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:09.855937 26843 log.cc:824] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:09.857610 26736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:09.858496 26736 log.cc:824] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:09.858599 26843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: No bootstrap required, opened a new log
I20260807 06:22:09.858645 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:09.858542 26620 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.858762 26620 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b264235913c42298416b7305641cc32, State: Initialized, Role: FOLLOWER
I20260807 06:22:09.859082 26620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.860044 26586 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6b264235913c42298416b7305641cc32"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38064
I20260807 06:22:09.860402 26620 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:09.860508 26586 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 06:22:09.860589 26736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: No bootstrap required, opened a new log
I20260807 06:22:09.860631 26586 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:09.861930 26586 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.864369 26843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.864661 26843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357275a75c3e446680083faf5912f9f3, State: Initialized, Role: FOLLOWER
I20260807 06:22:09.864589 26736 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.864802 26736 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8fe0c9255a841b99b6080fb9346f1ac, State: Initialized, Role: FOLLOWER
I20260807 06:22:09.865118 26843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.865139 26736 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
W20260807 06:22:09.865978 26877 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:09.866060 26877 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:09.866371 26856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.866528 26856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.866541 26736 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:09.866714 26843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:09.869976 26804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b264235913c42298416b7305641cc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "357275a75c3e446680083faf5912f9f3"
I20260807 06:22:09.870204 26804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:09.870487 26698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b264235913c42298416b7305641cc32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f8fe0c9255a841b99b6080fb9346f1ac"
W20260807 06:22:09.871518 26910 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:09.871595 26910 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:09.871981 26804 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b264235913c42298416b7305641cc32 in term 1.
I20260807 06:22:09.872385 26554 leader_election.cc:302] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357275a75c3e446680083faf5912f9f3, 6b264235913c42298416b7305641cc32; no voters:
I20260807 06:22:09.872668 26856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:09.872910 26856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [term 1 LEADER]: Becoming Leader. State: Replica: 6b264235913c42298416b7305641cc32, State: Running, Role: LEADER
I20260807 06:22:09.873235 26856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } }
I20260807 06:22:09.873294 26698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [term 0 FOLLOWER]: Advancing to term 1
W20260807 06:22:09.874471 26912 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:09.874553 26912 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:09.874854 26698 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b264235913c42298416b7305641cc32 in term 1.
I20260807 06:22:09.862917 26586 leader_election.cc:288] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [CANDIDATE]: Term 1 election: Requested vote from peers f8fe0c9255a841b99b6080fb9346f1ac (127.26.252.125:33147), 357275a75c3e446680083faf5912f9f3 (127.26.252.124:39369)
I20260807 06:22:09.876741 26918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b264235913c42298416b7305641cc32. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.876896 26918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:09.877305 26879 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.877424 26879 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.877928 26928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:09.879222 26928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:09.879249 26747 master_runner.cc:263] No leader master found from master 357275a75c3e446680083faf5912f9f3
I20260807 06:22:09.879320 26747 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:22:09.866179 26529 master_runner.cc:186] Error getting master registration for 127.26.252.125:33147: OK, instance_id { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" instance_seqno: 1786083729584072 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:22:09.879663 26529 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:22:09.880271 26634 master_runner.cc:263] No leader master found from master f8fe0c9255a841b99b6080fb9346f1ac
I20260807 06:22:09.880354 26634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:22:09.885272 26804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [term 1 FOLLOWER]: Refusing update from remote peer 6b264235913c42298416b7305641cc32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:22:09.885958 26918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:22:09.887315 26696 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [term 1 FOLLOWER]: Refusing update from remote peer 6b264235913c42298416b7305641cc32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:22:09.887936 26918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:22:09.889235 26745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.877925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.26.252.125:33147)
0807 06:22:09.878474 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.878479 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.878494 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:22:09.878530 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.878533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.878583 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.878661 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.880701 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.881330 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.882541 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.882925 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.883014 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.884996 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.885000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.885003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.885030 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.887144 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.887586 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.887592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.887595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.887691 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.888101 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.888107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.888110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.888364 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.888504 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.888884 (+ 380us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.889015 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416}
I20260807 06:22:09.891637 26879 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b264235913c42298416b7305641cc32. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.891767 26879 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.892303 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.881034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38066 (local address 127.26.252.126:35081)
0807 06:22:09.881184 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.881189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.881786 (+ 597us) server_negotiation.cc:407] Connection header received
0807 06:22:09.881954 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.881957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.882006 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.882053 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.883067 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.883929 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.885258 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.885669 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.885754 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.888583 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.888587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.888589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.888615 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.890468 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.890982 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.890986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.890988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.891074 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.891381 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.891384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.891386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.891585 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.891678 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.892031 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.892156 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:22:09.898518 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:09.881386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.26.252.124:39369)
0807 06:22:09.881505 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:09.881510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:09.890042 (+ 8532us) server_negotiation.cc:407] Connection header received
0807 06:22:09.890236 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:09.890242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:09.890299 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:09.890353 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:09.891182 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.891906 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.893240 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:09.893550 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:09.893626 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:09.895247 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:09.895251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:09.895254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:09.895280 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:09.896840 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.897267 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.897271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.897273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.897354 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:09.897636 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:09.897639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:09.897641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:09.897817 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:09.897952 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:09.898211 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 06:22:09.898332 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 06:22:09.899264 26856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.899385 26856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:09.899998 26879 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.900117 26879 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.900740 26928 catalog_manager.cc:1347] Generated new cluster ID: 9b2565b2273048ab90dd0e3b70226b8e
I20260807 06:22:09.900812 26928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:09.902550 26930 mvcc.cc:205] Tried to move back new op lower bound from 7315798957601447936 to 7315798957564071936. Current Snapshot: MvccSnapshot[applied={T|T < 7315798957601447936 or (T in {7315798957601447936})}]
I20260807 06:22:09.902981 26935 mvcc.cc:205] Tried to move back new op lower bound from 7315798957601447936 to 7315798957564071936. Current Snapshot: MvccSnapshot[applied={T|T < 7315798957601447936}]
I20260807 06:22:09.903245 26933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b264235913c42298416b7305641cc32. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.903553 26933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.912066 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.912205 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.912467 26856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.912596 26856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32 [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:09.913488 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b264235913c42298416b7305641cc32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b264235913c42298416b7305641cc32" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 35081 } } peers { permanent_uuid: "f8fe0c9255a841b99b6080fb9346f1ac" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 33147 } } peers { permanent_uuid: "357275a75c3e446680083faf5912f9f3" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 39369 } } }
I20260807 06:22:09.913606 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:09.913587 26937 mvcc.cc:205] Tried to move back new op lower bound from 7315798957601447936 to 7315798957564071936. Current Snapshot: MvccSnapshot[applied={T|T < 7315798957601447936}]
I20260807 06:22:09.936902 26928 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:09.938315 26928 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:09.964047 26928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b264235913c42298416b7305641cc32: Generated new TSK 0
I20260807 06:22:09.964962 26928 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:22:10.006608 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.003277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.26.252.125:33147)
0807 06:22:10.003415 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.003420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.005358 (+ 1938us) server_negotiation.cc:407] Connection header received
0807 06:22:10.005579 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.005583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.005638 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.005697 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.006452 (+ 755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33306: BlockingRecv error: recv got EOF from 127.0.0.1:33306 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 06:22:10.008693 26628 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.004670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.26.252.126:35081)
0807 06:22:10.004796 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.004800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.007362 (+ 2562us) server_negotiation.cc:407] Connection header received
0807 06:22:10.007627 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.007630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.007687 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.007743 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.008557 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38082: BlockingRecv error: recv got EOF from 127.0.0.1:38082 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260807 06:22:10.009500 26848 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.004192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.26.252.124:39369)
0807 06:22:10.004349 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.004354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.007169 (+ 2815us) server_negotiation.cc:407] Connection header received
0807 06:22:10.007893 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.007896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.007948 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.007998 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.009378 (+ 1380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55848: BlockingRecv error: recv got EOF from 127.0.0.1:55848 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260807 06:22:10.014501 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.012933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33320 (local address 127.26.252.125:33147)
0807 06:22:10.013040 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.013044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.013491 (+ 447us) server_negotiation.cc:407] Connection header received
0807 06:22:10.013707 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.013711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.013792 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.013843 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.014366 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33320: BlockingRecv error: recv got EOF from 127.0.0.1:33320 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 06:22:10.019543 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.018026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33334 (local address 127.26.252.125:33147)
0807 06:22:10.018128 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.018132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.018672 (+ 540us) server_negotiation.cc:407] Connection header received
0807 06:22:10.018860 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.018863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.018911 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.018960 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.019444 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33334: BlockingRecv error: recv got EOF from 127.0.0.1:33334 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 06:22:10.024982 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.023491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.26.252.125:33147)
0807 06:22:10.023596 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.023600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.024100 (+ 500us) server_negotiation.cc:407] Connection header received
0807 06:22:10.024307 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.024310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.024360 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.024410 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.024889 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33344: BlockingRecv error: recv got EOF from 127.0.0.1:33344 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 06:22:10.032294 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.030858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.26.252.125:33147)
0807 06:22:10.030985 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.030989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.031484 (+ 495us) server_negotiation.cc:407] Connection header received
0807 06:22:10.031649 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.031652 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.031696 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.031743 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.032192 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33352: BlockingRecv error: recv got EOF from 127.0.0.1:33352 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 06:22:10.044378 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.042517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33362 (local address 127.26.252.125:33147)
0807 06:22:10.042626 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.042631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.043301 (+ 670us) server_negotiation.cc:407] Connection header received
0807 06:22:10.043521 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.043525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.043583 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.043639 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.044276 (+ 637us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33362: BlockingRecv error: recv got EOF from 127.0.0.1:33362 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 06:22:10.065300 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.063128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33366 (local address 127.26.252.125:33147)
0807 06:22:10.063279 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.063285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.064071 (+ 786us) server_negotiation.cc:407] Connection header received
0807 06:22:10.064384 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.064388 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.064450 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.064512 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.065165 (+ 653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33366: BlockingRecv error: recv got EOF from 127.0.0.1:33366 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 06:22:10.101503 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.099975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.26.252.125:33147)
0807 06:22:10.100127 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.100132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.100448 (+ 316us) server_negotiation.cc:407] Connection header received
0807 06:22:10.100648 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.100652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.100704 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.100808 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.101370 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33380: BlockingRecv error: recv got EOF from 127.0.0.1:33380 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 06:22:10.169121 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.167784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33382 (local address 127.26.252.125:33147)
0807 06:22:10.167933 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.167937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.168240 (+ 303us) server_negotiation.cc:407] Connection header received
0807 06:22:10.168343 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.168345 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.168397 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.168496 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.168940 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33382: BlockingRecv error: recv got EOF from 127.0.0.1:33382 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 06:22:10.300875 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.299462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.26.252.125:33147)
0807 06:22:10.299632 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.299639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.299858 (+ 219us) server_negotiation.cc:407] Connection header received
0807 06:22:10.300045 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.300087 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.300143 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.300249 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.300773 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33392: BlockingRecv error: recv got EOF from 127.0.0.1:33392 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 06:22:10.560633 26745 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:10.559292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.26.252.125:33147)
0807 06:22:10.559432 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:10.559436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:10.559574 (+ 138us) server_negotiation.cc:407] Connection header received
0807 06:22:10.559704 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:10.559706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:10.559765 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:10.559883 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:10.560493 (+ 610us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33396: BlockingRecv error: recv got EOF from 127.0.0.1:33396 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:22:10.872944 26910 catalog_manager.cc:1259] Loaded cluster ID: 9b2565b2273048ab90dd0e3b70226b8e
I20260807 06:22:10.873070 26910 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: loading cluster ID for follower catalog manager: success
I20260807 06:22:10.874889 26910 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: acquiring CA information for follower catalog manager: success
I20260807 06:22:10.875810 26912 catalog_manager.cc:1259] Loaded cluster ID: 9b2565b2273048ab90dd0e3b70226b8e
I20260807 06:22:10.875872 26912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: loading cluster ID for follower catalog manager: success
I20260807 06:22:10.876204 26910 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 357275a75c3e446680083faf5912f9f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:22:10.877454 26912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: acquiring CA information for follower catalog manager: success
I20260807 06:22:10.878525 26912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f8fe0c9255a841b99b6080fb9346f1ac: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:22:11.079865 27031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:11.075329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33412 (local address 127.26.252.125:33147)
0807 06:22:11.075581 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:11.075585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:11.075603 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:22:11.075701 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:11.075704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:11.075858 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:11.075981 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:11.076375 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.077331 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.078352 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.078660 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.078747 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:11.079062 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:11.079527 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:11.079622 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:11.079683 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 06:22:11.079734 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":77,"threads_started":1}
I20260807 06:22:11.087226 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:11.083515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55862 (local address 127.26.252.124:39369)
0807 06:22:11.083743 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:11.083746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:11.083758 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:22:11.083854 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:11.083856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:11.083971 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:11.084100 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:11.084328 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.084849 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.085692 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.085931 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.086045 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:11.086361 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:11.086796 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:11.086936 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:11.086997 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 06:22:11.087053 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260807 06:22:11.095435 27031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:11.090800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.26.252.125:33147)
0807 06:22:11.090939 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:11.090944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:11.091278 (+ 334us) server_negotiation.cc:407] Connection header received
0807 06:22:11.091455 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:11.091459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:11.091512 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:11.091575 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:11.091996 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.092711 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.094156 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.094520 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.094655 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:11.094859 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:11.094941 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:11.095034 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:11.095194 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:22:11.095253 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:22:11.095466 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:11.090598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.26.252.126:35081)
0807 06:22:11.091098 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:11.091104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:11.091200 (+ 96us) server_negotiation.cc:407] Connection header received
0807 06:22:11.091425 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:11.091433 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:11.091616 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:11.091718 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:11.092175 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.092988 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.093901 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.094206 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.094304 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:11.094677 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:11.095001 (+ 324us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:11.095103 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:11.095245 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 06:22:11.095304 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":73,"threads_started":1}
I20260807 06:22:11.096091 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:11.090872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55874 (local address 127.26.252.124:39369)
0807 06:22:11.091010 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:11.091015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:11.091335 (+ 320us) server_negotiation.cc:407] Connection header received
0807 06:22:11.091463 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:11.091466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:11.091512 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:11.091587 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:11.091873 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.092838 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.094724 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:11.095019 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:11.095144 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:11.095585 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:11.095689 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:11.095765 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:11.095907 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 06:22:11.095960 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:22:11.103662 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26529
I20260807 06:22:11.116266 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26634
I20260807 06:22:11.130545 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 26747
2026-08-07T06:22:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3334 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:22:11 dist-test-slave-68xk krb5kdc[27052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:22:11 dist-test-slave-68xk krb5kdc[27052](info): set up 2 sockets
Aug 07 06:22:11 dist-test-slave-68xk krb5kdc[27052](info): commencing operation
krb5kdc: starting...
W20260807 06:22:12.423674 27633 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/test-user.keytab.
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:22:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:22:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.252.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
Entry for principal kudu/127.26.252.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab.
I20260807 06:22:12.557790 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34025
--webserver_interface=127.26.252.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:22:12.672695 27071 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:12.672977 27071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:12.673002 27071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:12.673110 27071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:12.677263 27071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:12.677335 27071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:12.677356 27071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:12.677373 27071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:12.677389 27071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:12.682834 27071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.126.keytab
--principal=kudu/127.26.252.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.126:34025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.252.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:12.684015 27071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:12.685101 27071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:12.695302 27082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:12.695237 27071 server_base.cc:1034] running on GCE node
W20260807 06:22:12.695284 27083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:12.695478 27088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:12.696072 27071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:12.697255 27071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:12.698460 27071 hybrid_clock.cc:648] HybridClock initialized: now 1786083732698427 us; error 41 us; skew 500 ppm
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:12.701313 27071 init.cc:377] Logged in from keytab as kudu/127.26.252.126@KRBTEST.COM (short username kudu)
I20260807 06:22:12.702159 27071 webserver.cc:460] Webserver started at http://127.26.252.126:40535/ using document root <none> and password file <none>
I20260807 06:22:12.702785 27071 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:12.702877 27071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:12.703114 27071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:12.705155 27071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data/instance:
uuid: "1e94f932ea834bab9fbc470fd3bd6bbb"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "bca85152fc24e9e1b812b9bda4b2597f"
server_key_iv: "7be89371005268c7a05baf64f545ec60"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.705727 27071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance:
uuid: "1e94f932ea834bab9fbc470fd3bd6bbb"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "bca85152fc24e9e1b812b9bda4b2597f"
server_key_iv: "7be89371005268c7a05baf64f545ec60"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.709429 27071 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260807 06:22:12.711890 27098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:12.713012 27071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 06:22:12.713160 27071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal
uuid: "1e94f932ea834bab9fbc470fd3bd6bbb"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "bca85152fc24e9e1b812b9bda4b2597f"
server_key_iv: "7be89371005268c7a05baf64f545ec60"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.713287 27071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:12.733414 27071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:12.736757 27071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:12.736977 27071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:12.744561 27071 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.126:34025
I20260807 06:22:12.744895 27174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.126:34025 every 8 connection(s)
I20260807 06:22:12.745589 27071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/data/info.pb
I20260807 06:22:12.745966 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27071
I20260807 06:22:12.746148 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-0/wal/instance
I20260807 06:22:12.746542 27633 external_mini_cluster.cc:1428] Setting key 96827b78d60ec3cb923893978e987355
I20260807 06:22:12.748559 27176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:12.752432 27176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.252.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.125@KRBTEST.COM" created.
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:12.769078 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.754796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34025 (local address 127.0.0.1:44016)
0807 06:22:12.755431 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.755497 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:12.756695 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:12.757420 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:12.757425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:12.757776 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:12.758100 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.758117 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.759537 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.759540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.760261 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.760270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.760928 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.760932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.761025 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.761693 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:12.761710 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:12.763257 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:12.766042 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:12.766051 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:12.766059 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:12.766294 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:12.766724 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:12.766733 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:12.766734 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:12.766847 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:12.767710 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:12.767715 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:12.767849 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 06:22:12.767991 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 06:22:12.768234 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":161,"threads_started":1}
I20260807 06:22:12.769080 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.754796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.26.252.126:34025)
0807 06:22:12.755383 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:12.755401 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:12.755631 (+ 230us) server_negotiation.cc:407] Connection header received
0807 06:22:12.757015 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:12.757020 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:12.757212 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:12.757366 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:12.758265 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.759409 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.760384 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.760769 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.760941 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.763439 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:12.763452 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:12.763471 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:12.763553 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:12.765915 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:12.766445 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:12.766452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:12.766454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:12.766614 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:12.766954 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:12.766957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:12.766960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:12.767577 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:12.767744 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:12.768140 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 06:22:12.768325 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"spinlock_wait_cycles":57728,"thread_start_us":161,"threads_started":1}
I20260807 06:22:12.771778 27176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:12.772516 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.772270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:38954)
0807 06:22:12.772391 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.772460 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:22:12.772698 27105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
I20260807 06:22:12.773764 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.773521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:38958)
0807 06:22:12.773662 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.773711 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 06:22:12.773926 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:41287: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
Entry for principal kudu/127.26.252.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab.
I20260807 06:22:12.779546 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:41287
--webserver_interface=127.26.252.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:22:12.823247 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } attempt: 1
I20260807 06:22:12.824180 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.823818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:38966)
0807 06:22:12.824001 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.824076 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 06:22:12.825017 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.824778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:38980)
0807 06:22:12.824894 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.824949 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:22:12.825209 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:41287: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
I20260807 06:22:12.893429 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } attempt: 2
I20260807 06:22:12.894318 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.893979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:38992)
0807 06:22:12.894150 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.894225 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 06:22:12.894479 27185 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:12.894814 27185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:12.894876 27185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:12.894950 27185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 06:22:12.895170 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.894928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:39008)
0807 06:22:12.895049 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.895106 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 06:22:12.895304 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.125:41287: Network error: Client connection negotiation failed: client connection to 127.26.252.125:41287: connect: Connection refused (error 111)
W20260807 06:22:12.899267 27185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:12.899322 27185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:12.899341 27185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:12.899379 27185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:12.899413 27185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:12.904734 27185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.125.keytab
--principal=kudu/127.26.252.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.125:41287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.252.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:12.905795 27185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:12.906908 27185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:12.915483 27196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:12.915454 27193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:12.915664 27194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:12.915920 27185 server_base.cc:1034] running on GCE node
I20260807 06:22:12.916657 27185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:12.918010 27185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:12.919211 27185 hybrid_clock.cc:648] HybridClock initialized: now 1786083732919192 us; error 34 us; skew 500 ppm
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:12.921950 27185 init.cc:377] Logged in from keytab as kudu/127.26.252.125@KRBTEST.COM (short username kudu)
I20260807 06:22:12.922856 27185 webserver.cc:460] Webserver started at http://127.26.252.125:40155/ using document root <none> and password file <none>
I20260807 06:22:12.923380 27185 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:12.923441 27185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:12.923606 27185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:12.926086 27185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data/instance:
uuid: "5164999210c54f4e9b5116d7f30c68f5"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "c073c3eb2ea1f14b93301706b92dbdc8"
server_key_iv: "5fd262adec9e0788366d320d88bbee1b"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.926944 27185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal/instance:
uuid: "5164999210c54f4e9b5116d7f30c68f5"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "c073c3eb2ea1f14b93301706b92dbdc8"
server_key_iv: "5fd262adec9e0788366d320d88bbee1b"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.931075 27185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:22:12.933691 27210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:12.935027 27185 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:22:12.935197 27185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal
uuid: "5164999210c54f4e9b5116d7f30c68f5"
format_stamp: "Formatted at 2026-08-07 06:22:12 on dist-test-slave-68xk"
server_key: "c073c3eb2ea1f14b93301706b92dbdc8"
server_key_iv: "5fd262adec9e0788366d320d88bbee1b"
server_key_version: "encryptionkey@0"
I20260807 06:22:12.935305 27185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:12.966820 27185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:12.969980 27185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:12.970223 27185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:12.977870 27185 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.125:41287
I20260807 06:22:12.978178 27281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.125:41287 every 8 connection(s)
I20260807 06:22:12.979014 27185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/data/info.pb
I20260807 06:22:12.981971 27283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:12.986107 27283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:12.986480 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } attempt: 3
I20260807 06:22:12.987190 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27185
I20260807 06:22:12.987545 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-1/wal/instance
I20260807 06:22:12.988029 27633 external_mini_cluster.cc:1428] Setting key ea59e9c1048bdb61b91a3d2c930797e2
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
Aug 07 06:22:12 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.252.124@KRBTEST.COM; defaulting to no policy
I20260807 06:22:13.001744 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.987025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:39016)
0807 06:22:12.987252 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.987270 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:12.987372 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:12.990910 (+ 3538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:12.990915 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:12.991165 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:12.991331 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.991342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.993528 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.993531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.994228 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.994238 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.994927 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.994931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.995031 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.995577 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:12.995590 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:12.997058 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:12.999596 (+ 2538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:12.999599 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:12.999601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:12.999812 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.000246 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.000249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.000251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.000364 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.001140 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.001143 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.001263 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.001392 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.001526 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.252.124@KRBTEST.COM" created.
I20260807 06:22:13.003031 27285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.988404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39016 (local address 127.26.252.125:41287)
0807 06:22:12.988881 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:12.988900 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:12.988944 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:22:12.990056 (+ 1112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:12.990108 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:12.990638 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:12.991512 (+ 874us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:12.991860 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.993372 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.994346 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.994798 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.994973 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.997208 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:12.997215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:12.997238 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:12.997266 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:12.999478 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:12.999935 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:12.999941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:12.999949 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.000095 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.000485 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.000488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.000490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.001003 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.001101 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.001620 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.001905 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":320,"thread_start_us":153,"threads_started":1}
I20260807 06:22:13.003537 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.989212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34025 (local address 127.0.0.1:44028)
0807 06:22:12.989755 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:12.989812 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:12.990620 (+ 808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:12.991054 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:12.991063 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:12.991434 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:12.991940 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.991951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.992717 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.992721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.993869 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:12.993880 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.996128 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.996139 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:12.996280 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.997256 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:12.997281 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:12.999502 (+ 2221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.001558 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.001567 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.001573 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.001882 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.002282 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.002288 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.002293 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.002442 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.002888 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.002894 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.003017 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.003157 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.003350 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":193,"spinlock_wait_cycles":9728,"thread_start_us":95,"threads_started":1}
I20260807 06:22:13.004637 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:12.989285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44028 (local address 127.26.252.126:34025)
0807 06:22:12.989452 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:12.989458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:12.990475 (+ 1017us) server_negotiation.cc:407] Connection header received
0807 06:22:12.990838 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:12.990841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:12.990899 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:12.990999 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:12.992082 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.992601 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.994056 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:12.995321 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:12.995471 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:12.999731 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:12.999735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:12.999741 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:12.999771 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.001436 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.002001 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.002005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.002009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.002147 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.002579 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.002581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.002583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.002744 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.002896 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.003244 (+ 348us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.003351 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:22:13.005591 27176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:13.006029 27283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:13.006457 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.006079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35786)
0807 06:22:13.006285 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.006348 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260807 06:22:13.009685 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.009151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35800)
0807 06:22:13.009494 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.009596 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258}
W20260807 06:22:13.009912 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:13.016124 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.006585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:39020)
0807 06:22:13.006730 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.006745 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.006826 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.007376 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.007382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.007612 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.007753 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.007763 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.008865 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.008871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.009682 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.009694 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.010314 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.010322 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.010477 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.011012 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.011026 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.012591 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.014757 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.014761 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.014763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.014970 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.015200 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.015202 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.015204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.015288 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.015647 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.015649 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.015722 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.015806 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.015971 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 06:22:13.016290 27285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.006973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.26.252.125:41287)
0807 06:22:13.007116 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.007123 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.007139 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:22:13.007178 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.007183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.007232 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.007327 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.007895 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.008732 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.009826 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.010132 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.010257 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.012728 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.012731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.012734 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.012763 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.014594 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.015053 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.015055 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.015056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.015106 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.015382 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.015385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.015389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.015548 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.015624 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.015889 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.016051 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":55}
I20260807 06:22:13.017320 27283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:13.017999 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.017755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35812)
0807 06:22:13.017845 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.017918 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 06:22:13.018231 27213 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
I20260807 06:22:13.019130 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.018912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35818)
0807 06:22:13.019009 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.019051 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 06:22:13.019313 27283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
Entry for principal kudu/127.26.252.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab.
I20260807 06:22:13.021508 27633 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
/tmp/dist-test-taskC7DYJg/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:36637
--webserver_interface=127.26.252.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.252.84:46019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:22:13.041090 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 1
I20260807 06:22:13.041976 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.041622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35834)
0807 06:22:13.041818 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.041883 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 06:22:13.042817 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.042562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35836)
0807 06:22:13.042689 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.042750 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 06:22:13.042964 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
I20260807 06:22:13.068620 27283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 1
I20260807 06:22:13.069586 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.069261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35852)
0807 06:22:13.069428 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.069504 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 06:22:13.070389 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.070150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35860)
0807 06:22:13.070271 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.070326 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 06:22:13.070597 27283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
I20260807 06:22:13.118116 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 2
I20260807 06:22:13.119091 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.118710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35868)
0807 06:22:13.118900 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.118983 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 06:22:13.120002 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.119695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35878)
0807 06:22:13.119819 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.119928 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:22:13.120162 27176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
I20260807 06:22:13.138763 27283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 2
I20260807 06:22:13.139555 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.139252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35880)
0807 06:22:13.139394 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.139480 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 06:22:13.140450 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.140194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35882)
0807 06:22:13.140334 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.140391 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 06:22:13.140620 27283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.252.124:36637: Network error: Client connection negotiation failed: client connection to 127.26.252.124:36637: connect: Connection refused (error 111)
W20260807 06:22:13.140643 27294 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 06:22:13.140990 27294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:22:13.141038 27294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:22:13.141121 27294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:22:13.145388 27294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:22:13.145445 27294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:22:13.145465 27294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:22:13.145481 27294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:22:13.145542 27294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:22:13.150806 27294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.252.84:46019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.252.126:34025,127.26.252.125:41287,127.26.252.124:36637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/krb5kdc/kudu_127.26.252.124.keytab
--principal=kudu/127.26.252.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.252.124:36637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.252.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 07 Aug 2026 05:39:39 UTC on ccycloud.quasar-xaluan.root.comops.site
build id 4571902
I20260807 06:22:13.151823 27294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:22:13.152835 27294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:22:13.161309 27309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:13.161338 27305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:22:13.161345 27306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:22:13.161438 27294 server_base.cc:1034] running on GCE node
I20260807 06:22:13.162253 27294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:22:13.163374 27294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:22:13.164569 27294 hybrid_clock.cc:648] HybridClock initialized: now 1786083733164545 us; error 39 us; skew 500 ppm
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083733, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:22:13.167470 27294 init.cc:377] Logged in from keytab as kudu/127.26.252.124@KRBTEST.COM (short username kudu)
I20260807 06:22:13.168340 27294 webserver.cc:460] Webserver started at http://127.26.252.124:35151/ using document root <none> and password file <none>
I20260807 06:22:13.168839 27294 fs_manager.cc:359] Metadata directory not provided
I20260807 06:22:13.168898 27294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:22:13.169059 27294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:22:13.171085 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data/instance:
uuid: "68c3f9f4e1b04129b4dc079a9782e918"
format_stamp: "Formatted at 2026-08-07 06:22:13 on dist-test-slave-68xk"
server_key: "cae562fa94479de1a26aac477ef88188"
server_key_iv: "d01472d3b1bcbbadabe53468f638e23a"
server_key_version: "encryptionkey@0"
I20260807 06:22:13.171597 27294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal/instance:
uuid: "68c3f9f4e1b04129b4dc079a9782e918"
format_stamp: "Formatted at 2026-08-07 06:22:13 on dist-test-slave-68xk"
server_key: "cae562fa94479de1a26aac477ef88188"
server_key_iv: "d01472d3b1bcbbadabe53468f638e23a"
server_key_version: "encryptionkey@0"
I20260807 06:22:13.175307 27294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:22:13.177695 27318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:22:13.179174 27294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:22:13.179303 27294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data,/tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal
uuid: "68c3f9f4e1b04129b4dc079a9782e918"
format_stamp: "Formatted at 2026-08-07 06:22:13 on dist-test-slave-68xk"
server_key: "cae562fa94479de1a26aac477ef88188"
server_key_iv: "d01472d3b1bcbbadabe53468f638e23a"
server_key_version: "encryptionkey@0"
I20260807 06:22:13.179417 27294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:22:13.202975 27294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:22:13.206257 27294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:22:13.206507 27294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:22:13.213662 27294 rpc_server.cc:307] RPC server started. Bound to: 127.26.252.124:36637
I20260807 06:22:13.213973 27397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.252.124:36637 every 8 connection(s)
I20260807 06:22:13.214730 27294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/data/info.pb
I20260807 06:22:13.217715 27398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:22:13.218657 27633 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu as pid 27294
I20260807 06:22:13.218802 27633 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskC7DYJg/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786083434177398-27633-0/minicluster-data/master-2/wal/instance
I20260807 06:22:13.219117 27633 external_mini_cluster.cc:1428] Setting key e0cf48d0be6db7cb8840866d54d2aba2
I20260807 06:22:13.219337 27176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 3
I20260807 06:22:13.222492 27398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.126@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083733, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:13.231789 27283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } attempt: 3
I20260807 06:22:13.233726 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.219775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35908)
0807 06:22:13.219993 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.220010 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.220117 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.222429 (+ 2312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.222433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.222645 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.222766 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.222774 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.224407 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.224411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.225253 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.225262 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.226032 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.226036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.226121 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.226719 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.226737 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.227995 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.230656 (+ 2661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.230661 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.230663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.230882 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.231274 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.231277 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.231278 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.231360 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.232822 (+ 1462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.232826 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.232940 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.233051 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.233528 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260807 06:22:13.234634 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.220455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35896 (local address 127.26.252.124:36637)
0807 06:22:13.220900 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.220936 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.220981 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:22:13.221745 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.221773 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.222109 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.222467 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.223284 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.224150 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.225364 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.225905 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.226068 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.229084 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.229089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.229093 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.229124 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.231071 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.232190 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.232194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.232195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.232273 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.232605 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.232609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.232611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.233008 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.233208 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.234040 (+ 832us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.234166 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":302,"thread_start_us":132,"threads_started":1}
I20260807 06:22:13.234632 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.221007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35908 (local address 127.26.252.124:36637)
0807 06:22:13.221345 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.221353 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.221368 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:22:13.221765 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.221779 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.222113 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.222903 (+ 790us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.223035 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.224185 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.225392 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.225903 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.226067 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.228186 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.228191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.228199 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.228252 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.230542 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.231011 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.231016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.231020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.231175 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.231459 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.231463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.231466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.231996 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.233159 (+ 1163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.233338 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.233630 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":235,"spinlock_wait_cycles":13056,"thread_start_us":117,"threads_started":1}
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.125@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:13.237251 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.224562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44044 (local address 127.26.252.126:34025)
0807 06:22:13.224669 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.224673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.225019 (+ 346us) server_negotiation.cc:407] Connection header received
0807 06:22:13.225232 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.225235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.225282 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.225355 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.226183 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.226938 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.228260 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.228625 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.228754 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.232417 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.232421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.232426 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.232455 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.234887 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.235426 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.235430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.235432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.235535 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.235840 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.235843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.235845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.236163 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.236283 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.236963 (+ 680us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.237101 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:22:13.238238 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.224514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.126:34025 (local address 127.0.0.1:44044)
0807 06:22:13.224902 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.224952 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.225116 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.225453 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.225459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.225905 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.226046 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.226054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.227092 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.227095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.228126 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.228140 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.228775 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.228780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.229302 (+ 522us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.229815 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.229834 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.232259 (+ 2425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.235006 (+ 2747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.235015 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.235020 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.235309 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.235641 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.235645 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.235647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.235737 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.236578 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.236584 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.236711 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.237821 (+ 1110us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.238045 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":87,"threads_started":1}
I20260807 06:22:13.239533 27398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:13.240916 27176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: Bootstrap starting.
I20260807 06:22:13.243099 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.232255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35910)
0807 06:22:13.232462 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.232477 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.232562 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.233092 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.233095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.233285 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.233389 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.233396 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.234713 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.234717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.235475 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.235484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.236048 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.236053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.236164 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.236626 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.236641 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.238279 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.241413 (+ 3134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.241416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.241418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.241656 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.241976 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.241979 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.241981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.242071 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.242583 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.242587 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.242680 (+ 93us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.242761 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.242893 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260807 06:22:13.243963 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.232301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35910 (local address 127.26.252.124:36637)
0807 06:22:13.232579 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.232590 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.232606 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:22:13.232641 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.232643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.232686 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.233758 (+ 1072us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.233845 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.234571 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.235587 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.235929 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.236032 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.239070 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.239076 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.239081 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.239109 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.241286 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.241783 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.241786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.241787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.241870 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.242198 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.242202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.242205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.242465 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.243598 (+ 1133us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.243675 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.243782 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":221,"thread_start_us":80,"threads_started":1}
I20260807 06:22:13.244201 27176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: Neither blocks nor log segments found. Creating new log.
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.126@KRBTEST.COM
I20260807 06:22:13.245501 27176 log.cc:824] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083733, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:13.247454 27283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: Bootstrap starting.
I20260807 06:22:13.248827 27176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: No bootstrap required, opened a new log
I20260807 06:22:13.249928 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.238465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.26.252.126:34025)
0807 06:22:13.238778 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.238782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.238798 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:22:13.238835 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.238838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.238876 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.238956 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.239899 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.240709 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.241931 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.242308 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.242383 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.245667 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.245672 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.245674 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.245702 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.247630 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.248207 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.248212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.248217 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.248324 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.248723 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.248729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.248732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.248998 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.249190 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.249629 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.249761 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238}
I20260807 06:22:13.250029 27283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:13.250530 27285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.240347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39036 (local address 127.26.252.125:41287)
0807 06:22:13.240485 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.240489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.240504 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:22:13.240542 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.240545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.240593 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.240680 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.241296 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.242081 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.243305 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.243772 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.243872 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.246585 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.246591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.246596 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.246629 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.248329 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.248903 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.248907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.248909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.248995 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.249366 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.249370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.249372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.249669 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.249753 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.250157 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.250287 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:22:13.250926 27283 log.cc:824] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:13.251319 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.240112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.125:41287 (local address 127.0.0.1:39036)
0807 06:22:13.240255 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.240270 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.240481 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.240798 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.240804 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.241056 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.241150 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.241158 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.242223 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.242226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.243142 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.243156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.244052 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.244056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.244171 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.244719 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.244734 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.246360 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.248457 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.248460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.248462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.248778 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.249135 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.249138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.249140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.249246 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.249836 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.249840 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.249935 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.251009 (+ 1074us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.251173 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 06:22:13.252206 27398 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:22:13.253130 27176 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.253437 27176 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e94f932ea834bab9fbc470fd3bd6bbb, State: Initialized, Role: FOLLOWER
I20260807 06:22:13.253541 27283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: No bootstrap required, opened a new log
I20260807 06:22:13.253883 27176 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.255355 27176 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:13.257777 27283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.258080 27283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5164999210c54f4e9b5116d7f30c68f5, State: Initialized, Role: FOLLOWER
I20260807 06:22:13.258181 27410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083733, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.252.124@KRBTEST.COM for kudu/127.26.252.124@KRBTEST.COM
I20260807 06:22:13.258517 27410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.258513 27283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
Aug 07 06:22:13 dist-test-slave-68xk krb5kdc[27052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786083732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.252.125@KRBTEST.COM
I20260807 06:22:13.260017 27283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:13.265520 27285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.251900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39050 (local address 127.26.252.125:41287)
0807 06:22:13.252031 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.252035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.252345 (+ 310us) server_negotiation.cc:407] Connection header received
0807 06:22:13.252540 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.252546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.252601 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.252662 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.253649 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.254536 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.255757 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.256183 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.256266 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.260708 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.260714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.260721 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.260756 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.263003 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.263787 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.263794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.263796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.263901 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.264304 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.264308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.264310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.264542 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.264700 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.265176 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.265329 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 06:22:13.265776 27428 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:13.265923 27428 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:13.262260 27071 master_runner.cc:186] Error getting master registration for 127.26.252.125:41287: OK, instance_id { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" instance_seqno: 1786083732975703 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:22:13.266264 27071 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:22:13.266516 27429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.266752 27429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.267060 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.253016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35912 (local address 127.26.252.124:36637)
0807 06:22:13.253132 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.253139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.253285 (+ 146us) server_negotiation.cc:407] Connection header received
0807 06:22:13.253442 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.253445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.253486 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.253536 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.254066 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.254875 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.255967 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.256395 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.256471 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.259118 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.259125 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.259131 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.259165 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.260974 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.261505 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.261511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.261514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.261640 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.262019 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.262022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.262024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.262258 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.262339 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.266743 (+ 4404us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.266887 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 06:22:13.267524 27405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.252728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.252.124:36637 (local address 127.0.0.1:35912)
0807 06:22:13.253215 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 06:22:13.253231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:22:13.253345 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:22:13.253686 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:22:13.253689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:22:13.253864 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:22:13.253949 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.253956 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.254995 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.254998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.255853 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:22:13.255863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.256619 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.256624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:22:13.256744 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.257192 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:22:13.257208 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:22:13.258967 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:22:13.261098 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.261101 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.261103 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.261386 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.261794 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:22:13.261799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:22:13.261803 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:22:13.261903 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:22:13.262410 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:22:13.262413 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:22:13.262534 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 06:22:13.267224 (+ 4690us) client_negotiation.cc:240] Negotiation successful
0807 06:22:13.267385 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423}
I20260807 06:22:13.270879 27398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: Bootstrap starting.
W20260807 06:22:13.270929 27446 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:13.271003 27446 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:13.273866 27398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: Neither blocks nor log segments found. Creating new log.
I20260807 06:22:13.275558 27398 log.cc:824] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: Log is configured to *not* fsync() on all Append() calls
I20260807 06:22:13.276862 27633 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:22:13.278209 27138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44056
I20260807 06:22:13.278504 27138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 06:22:13.278635 27138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:13.275769 27185 master_runner.cc:186] Error getting master registration for 127.26.252.124:36637: OK, instance_id { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" instance_seqno: 1786083733211719 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:22:13.279369 27185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:22:13.280098 27138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.282483 27246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5164999210c54f4e9b5116d7f30c68f5"
I20260807 06:22:13.282769 27246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:13.283835 27138 leader_election.cc:288] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [CANDIDATE]: Term 1 election: Requested vote from peers 5164999210c54f4e9b5116d7f30c68f5 (127.26.252.125:41287), 68c3f9f4e1b04129b4dc079a9782e918 (127.26.252.124:36637)
I20260807 06:22:13.284229 27246 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e94f932ea834bab9fbc470fd3bd6bbb in term 1.
I20260807 06:22:13.286219 27398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: No bootstrap required, opened a new log
I20260807 06:22:13.290787 27105 leader_election.cc:302] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e94f932ea834bab9fbc470fd3bd6bbb, 5164999210c54f4e9b5116d7f30c68f5; no voters:
I20260807 06:22:13.291069 27410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:22:13.291307 27410 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [term 1 LEADER]: Becoming Leader. State: Replica: 1e94f932ea834bab9fbc470fd3bd6bbb, State: Running, Role: LEADER
I20260807 06:22:13.291687 27410 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.292208 27398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.292658 27398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68c3f9f4e1b04129b4dc079a9782e918, State: Initialized, Role: FOLLOWER
I20260807 06:22:13.293202 27398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } }
I20260807 06:22:13.293669 27410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e94f932ea834bab9fbc470fd3bd6bbb. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.293818 27410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:13.295601 27360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "68c3f9f4e1b04129b4dc079a9782e918"
I20260807 06:22:13.295827 27360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:22:13.297161 27360 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e94f932ea834bab9fbc470fd3bd6bbb in term 1.
I20260807 06:22:13.297669 27470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:22:13.295536 27398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:22:13.299041 27470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:22:13.302000 27468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.302146 27468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.307878 27181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.286783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.26.252.126:34025)
0807 06:22:13.286925 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.286931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.288740 (+ 1809us) server_negotiation.cc:407] Connection header received
0807 06:22:13.289160 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.289164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.289222 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.289278 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.293178 (+ 3900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.294054 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.301474 (+ 7420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.301867 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.301950 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.303996 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.304001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.304004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.304036 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.305739 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.306278 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.306282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.306284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.306373 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.306814 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.306819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.306822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.307071 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.307199 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.307570 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.307715 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 06:22:13.310262 27486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:22:13.310354 27486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:22:13.315768 27285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.287474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39058 (local address 127.26.252.125:41287)
0807 06:22:13.287602 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.287606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.289075 (+ 1469us) server_negotiation.cc:407] Connection header received
0807 06:22:13.290844 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.290848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.290902 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.290956 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.295392 (+ 4436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.296235 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.303280 (+ 7045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.303620 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.303698 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.309712 (+ 6014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.309718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.309723 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.309774 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.311588 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.314364 (+ 2776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.314368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.314370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.314480 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.314795 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.314798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.314800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.315015 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.315139 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.315478 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.315595 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 06:22:13.315920 27406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:13.288152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35924 (local address 127.26.252.124:36637)
0807 06:22:13.288265 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.288270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.290758 (+ 2488us) server_negotiation.cc:407] Connection header received
0807 06:22:13.292064 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.292068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.292118 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.292171 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.297476 (+ 5305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.298395 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.302334 (+ 3939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:13.303052 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:13.303133 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:13.312121 (+ 8988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:22:13.312125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:22:13.312128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:22:13.312155 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:22:13.313850 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.314361 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.314365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.314367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.314518 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:22:13.314870 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:22:13.314874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:22:13.314876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:22:13.315100 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:22:13.315233 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:13.315612 (+ 379us) server_negotiation.cc:299] Negotiation successful
0807 06:22:13.315737 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":35}
I20260807 06:22:13.324689 27360 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [term 1 FOLLOWER]: Refusing update from remote peer 1e94f932ea834bab9fbc470fd3bd6bbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:22:13.325392 27463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:22:13.332041 27468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e94f932ea834bab9fbc470fd3bd6bbb. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.332182 27468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.333838 27246 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [term 1 FOLLOWER]: Refusing update from remote peer 1e94f932ea834bab9fbc470fd3bd6bbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:22:13.334429 27463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:22:13.338339 27429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e94f932ea834bab9fbc470fd3bd6bbb. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.338487 27429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.346607 27463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.346778 27463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:13.348136 27468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.348259 27468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.349501 27410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.349651 27410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb [sys.catalog]: This master's current role is: LEADER
I20260807 06:22:13.352659 27429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e94f932ea834bab9fbc470fd3bd6bbb" member_type: VOTER last_known_addr { host: "127.26.252.126" port: 34025 } } peers { permanent_uuid: "5164999210c54f4e9b5116d7f30c68f5" member_type: VOTER last_known_addr { host: "127.26.252.125" port: 41287 } } peers { permanent_uuid: "68c3f9f4e1b04129b4dc079a9782e918" member_type: VOTER last_known_addr { host: "127.26.252.124" port: 36637 } } }
I20260807 06:22:13.352780 27429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:22:13.353820 27493 mvcc.cc:205] Tried to move back new op lower bound from 7315798971679731712 to 7315798971566665728. Current Snapshot: MvccSnapshot[applied={T|T < 7315798971679731712}]
I20260807 06:22:13.359089 27470 catalog_manager.cc:1347] Generated new cluster ID: f679b5161b5e4598bbd88ac29281fd2c
I20260807 06:22:13.359167 27470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:22:13.387521 27470 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:22:13.388898 27470 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:22:13.412159 27470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e94f932ea834bab9fbc470fd3bd6bbb: Generated new TSK 0
I20260807 06:22:13.413065 27470 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:22:13.447643 27181 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.443843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.26.252.126:34025)
0807 06:22:13.443983 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.443988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.446150 (+ 2162us) server_negotiation.cc:407] Connection header received
0807 06:22:13.446637 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.446640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.446704 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.446765 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.447478 (+ 713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44078: BlockingRecv error: recv got EOF from 127.0.0.1:44078 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 06:22:13.449218 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.444666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39070 (local address 127.26.252.125:41287)
0807 06:22:13.444791 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.444796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.446530 (+ 1734us) server_negotiation.cc:407] Connection header received
0807 06:22:13.448343 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.448348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.448416 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.448473 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.449081 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39070: BlockingRecv error: recv got EOF from 127.0.0.1:39070 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 06:22:13.450539 27406 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.445426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35932 (local address 127.26.252.124:36637)
0807 06:22:13.445553 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.445558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.448096 (+ 2538us) server_negotiation.cc:407] Connection header received
0807 06:22:13.449621 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.449625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.449688 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.449748 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.450361 (+ 613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35932: BlockingRecv error: recv got EOF from 127.0.0.1:35932 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 06:22:13.455916 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.454087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.26.252.125:41287)
0807 06:22:13.454206 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.454211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.454844 (+ 633us) server_negotiation.cc:407] Connection header received
0807 06:22:13.455082 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.455086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.455167 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.455229 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.455805 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39082: BlockingRecv error: recv got EOF from 127.0.0.1:39082 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 06:22:13.461185 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.459466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39090 (local address 127.26.252.125:41287)
0807 06:22:13.459573 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.459577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.460179 (+ 602us) server_negotiation.cc:407] Connection header received
0807 06:22:13.460395 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.460399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.460454 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.460520 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.461079 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39090: BlockingRecv error: recv got EOF from 127.0.0.1:39090 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 06:22:13.467020 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.465277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39104 (local address 127.26.252.125:41287)
0807 06:22:13.465385 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.465389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.465988 (+ 599us) server_negotiation.cc:407] Connection header received
0807 06:22:13.466208 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.466211 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.466268 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.466326 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.466918 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39104: BlockingRecv error: recv got EOF from 127.0.0.1:39104 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 06:22:13.475016 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.473148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.26.252.125:41287)
0807 06:22:13.473297 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.473303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.473922 (+ 619us) server_negotiation.cc:407] Connection header received
0807 06:22:13.474143 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.474147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.474207 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.474272 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.474902 (+ 630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39108: BlockingRecv error: recv got EOF from 127.0.0.1:39108 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 06:22:13.487027 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.485296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.26.252.125:41287)
0807 06:22:13.485407 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.485412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.486010 (+ 598us) server_negotiation.cc:407] Connection header received
0807 06:22:13.486211 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.486214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.486268 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.486322 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.486909 (+ 587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39124: BlockingRecv error: recv got EOF from 127.0.0.1:39124 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 06:22:13.506943 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.505488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.26.252.125:41287)
0807 06:22:13.505621 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.505626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.505923 (+ 297us) server_negotiation.cc:407] Connection header received
0807 06:22:13.506065 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.506069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.506136 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.506244 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.506823 (+ 579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39128: BlockingRecv error: recv got EOF from 127.0.0.1:39128 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 06:22:13.542094 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.540816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39144 (local address 127.26.252.125:41287)
0807 06:22:13.541055 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.541059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.541170 (+ 111us) server_negotiation.cc:407] Connection header received
0807 06:22:13.541294 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.541297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.541349 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.541433 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.541994 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39144: BlockingRecv error: recv got EOF from 127.0.0.1:39144 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
W20260807 06:22:13.609613 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.608415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39150 (local address 127.26.252.125:41287)
0807 06:22:13.608611 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.608616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.608753 (+ 137us) server_negotiation.cc:407] Connection header received
0807 06:22:13.608884 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.608886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.608936 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.609020 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.609462 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39150: BlockingRecv error: recv got EOF from 127.0.0.1:39150 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 06:22:13.741245 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.740103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39162 (local address 127.26.252.125:41287)
0807 06:22:13.740265 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.740269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.740342 (+ 73us) server_negotiation.cc:407] Connection header received
0807 06:22:13.740462 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:13.740464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:13.740514 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:13.740589 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:13.741112 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39162: BlockingRecv error: recv got EOF from 127.0.0.1:39162 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 06:22:14.000856 27285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:22:13.999537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39168 (local address 127.26.252.125:41287)
0807 06:22:13.999700 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:13.999705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:13.999887 (+ 182us) server_negotiation.cc:407] Connection header received
0807 06:22:14.000063 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.000067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.000127 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.000229 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:22:14.000753 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39168: BlockingRecv error: recv got EOF from 127.0.0.1:39168 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:22:14.272385 27446 catalog_manager.cc:1259] Loaded cluster ID: f679b5161b5e4598bbd88ac29281fd2c
I20260807 06:22:14.272519 27446 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: loading cluster ID for follower catalog manager: success
I20260807 06:22:14.274312 27446 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: acquiring CA information for follower catalog manager: success
I20260807 06:22:14.275532 27446 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5164999210c54f4e9b5116d7f30c68f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:22:14.313634 27486 catalog_manager.cc:1259] Loaded cluster ID: f679b5161b5e4598bbd88ac29281fd2c
I20260807 06:22:14.313763 27486 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: loading cluster ID for follower catalog manager: success
I20260807 06:22:14.315687 27486 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: acquiring CA information for follower catalog manager: success
I20260807 06:22:14.317111 27486 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 68c3f9f4e1b04129b4dc079a9782e918: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:22:14.519547 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:14.515396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.26.252.125:41287)
0807 06:22:14.515662 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:14.515667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:14.515787 (+ 120us) server_negotiation.cc:407] Connection header received
0807 06:22:14.515979 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.515981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.516177 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.516298 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:14.516624 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.517156 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.518090 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.518343 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.518485 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:14.518756 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:14.519187 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:14.519313 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:14.519366 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 06:22:14.519418 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":74,"threads_started":1}
I20260807 06:22:14.525962 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:14.522585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35940 (local address 127.26.252.124:36637)
0807 06:22:14.522848 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:14.522852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:14.522865 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:22:14.522945 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.522947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.523055 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.523150 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:14.523332 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.523841 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.524604 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.524860 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.524934 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:14.525197 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:14.525560 (+ 363us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:14.525647 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:14.525711 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 06:22:14.525770 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":101,"threads_started":1}
I20260807 06:22:14.533116 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:14.529508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35948 (local address 127.26.252.124:36637)
0807 06:22:14.529646 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:14.529651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:14.529663 (+ 12us) server_negotiation.cc:407] Connection header received
0807 06:22:14.529706 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.529709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.529759 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.529829 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:14.530159 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.530963 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.531946 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.532179 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.532295 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:14.532604 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:14.532702 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:14.532795 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:14.532928 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 06:22:14.532993 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:22:14.533565 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:14.529238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39184 (local address 127.26.252.125:41287)
0807 06:22:14.529399 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:14.529409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:14.529697 (+ 288us) server_negotiation.cc:407] Connection header received
0807 06:22:14.529841 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.529847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.529901 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.529983 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:14.530283 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.531058 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.532266 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.532589 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.532678 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:14.533017 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:14.533094 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:14.533145 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:14.533372 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:22:14.533440 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:22:14.534353 27621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:22:14.528979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44094 (local address 127.26.252.126:34025)
0807 06:22:14.529687 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0807 06:22:14.529692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:22:14.529703 (+ 11us) server_negotiation.cc:407] Connection header received
0807 06:22:14.529800 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:22:14.529806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:22:14.529955 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:22:14.530115 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:22:14.530341 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.530930 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.532740 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:22:14.533116 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:22:14.533248 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:22:14.533575 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:22:14.533913 (+ 338us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:22:14.534056 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:22:14.534148 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 06:22:14.534210 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":76,"threads_started":1}
I20260807 06:22:14.537359 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27071
I20260807 06:22:14.549528 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27185
I20260807 06:22:14.560645 27633 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskC7DYJg/build/debug/bin/kudu with pid 27294
2026-08-07T06:22:14Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3426 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6761 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (300378 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST